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(54) Picture processing apparatus, picture processing method 



(57) An MPEG1 real tinne encoder board (213) gen- 
erates Index data as an evaluation value representing 
the conplexrty of a picture. A scene change parameter 
representing the degree off a sc^e change occurring in 
the picture is then calculated from the index data. The 
scene change parameter is associated with a scene 
change pointer, tffiat is, position information on a loca- 
tion off the picture in which a scene change occurs to a 
degree indicated by the scene change parameter. The 



scene change parameter and the scene change pointer 
are recorded as an index in an index f De. On the other 
hand, an MPEG system stream output by the MPEQ1 
real time encoder board (213) is stored in an MPEG file 
separated from the index file. 
With the funtions descrft>ed above, a desired scene can 
be searched for with easa 
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BACKGROUND OF THE INVENTION In general, the present invention relates to a 

picture processing apparatus, a picture processing n^ethod arvJ a recording medium. In particular, ttie present 
invention relates to a picture processing apparatus, a picture processing mettiod and a recording medium being capa- 
t)le of carrying out search of a desired scene with ease. 

With the increasing speed and the increasing number of functions of the CPU (Central Processing Unit) as well as 
the increasing storage capacity of the memory, the hard disc and other recon£ng and storage mecfia along with the 
deaeastng price of hardware indudtng the CPU and the recording and the storage media seen in recent years, a high 
performance computer can be implemented at a price that ttie personal user can afford. 

Wrtii tile popularization of a high periormance conrputer at such a price, there is a rising user demand for computer 
functions of carrying out various kinds of processing such as recording, reproduction arxJ editing of a processing object 
with a large anx>unt of data such as a picture which were impossible so far but can now be implemented through sinple 
user operations. 

SUMMARY OF TVIE INVENTION 

It is thus an object of the present invention addressing the problem descrbed above to allow various kinds of 
processing demarxied by the user to be carried out tfvough simple operations. 

A picture processing apparatus for processing a picture according to claim 1 is characterized in that said apparatus 
conprises: 

a corrputing means for computing a scene change paranteter representing a degree of a scene change in said pic- 
ture; and 

a recording means for recording said scene change parameter and position information on a position of said picture 
with a degree of a scene change thereof represerrted by said scene change parameter by assoctatir^ said scene 
change paranieter witti said position information. 

A picture processing mettwd for processing a picture according to daim 9 is characterized in ttiat said method com- 
prises the steps of: 

conputing a scene change parameter representing a degree of a scene change in said picture; and 
recorcfing saki scene change parameter and px>sition information on a position of said pfoture with a deg'ee of a 
scene change thereof represented by saki scene change parameter by associating sakJ scene change parameter 
with saki position information. 

A recording medium ibr storing a program to let a computer process a picture accorcfing to daim 10 is character^ 
in that saki program prescrOt>es a picture processir^ method comprising the steps of: 

computing a scene change parameter representing a degree of a scene change in saki pkrture; and 
recordng saki scene change parameter and position information on a position of said pfoture with a degree of a 
scene charige thereof represented by saki scene charge parartfeter by associating saki scene change parameter 
with saki position information. 

A recording medium according to daim 1 1 is characterized in tfiat saki medium is used for storing data obtained as 
a result of processing a pk:ture in addition to a scene change parameter and position information on a position of saki 
picture with a degree of a scene change thereof represented by saki scene change parameter by assodating saki 
scene change parameter witti saki position information. 

In a picture processing apparatus for processing a picture according to daim 1 , 

a computing means computes a scene change paranrYeter representing a degree of a scene change in saki pk:ture: 
and 

a recording means records saki scene change paranieter and position information on a position of saki pkiture with 
a degree of a scene change thereof represented by saki scene change parameter by associating saki scene 
change parameter with saki position Information. 

A picture processing mettKXi for processing a pkrture according to daim 9 comprises the steps of: 
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computing a scene change parameter representing a degree of a scene change in said picture; arxj 
recorcfing said sc^e change parameter and position Information on a position of said picture with a degree of a 
scene change thereof represented by said scene change paranrieter by associating said scene change parameter 
with said position informatioa 

5 

A recording niedium according to claim 10 is used for storing a program to let a conputer process 
said program prescribes a picture processing method compr^ng the steps of: 

computing a scene change parameter representing a degree of a scene change in said picture; and 
10 recording said scene change parameter and position information on a position of said picture with a degree of a 
scene change thereof represented by said scene change parameter by associating said scene change parameter 
with said position information. 

A recording medium according to daim 11 is used for storing data obtained as a result of processing a picture in 
IS addition to a scene change parameter and position information on a position of said picti^e with a degree of a scene 
change thereof represented by said scene change paranf)eter by associating said scene change parameter witti said 
position information. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 

Preferred embodments of the present invention will t>e descrfoed by refening to the following diagrams wfierein: 

Rg. 1 is a diagram showing a perspective view of a typical configuration of an emtxxliment implementing a per- 
sonal computer to which the present invention is appOed; 
2S Fig. 2 is a diagram showing a perspective view of a typical configuration of an embodiment irrplementing a per- 
sonal computer to which the present invention is applied; 

Fig. 3 is a diagram shewing a front view of a nrtain unit 31 of the personal computers shown in Rgs. 1 and 2; 
Fig. 4 is a diagram shmving a rear view of the nrtain unit 31 shown in Rg. 3; 

Fig. 5 is a diagram shming a typical electrical configuration of the personal computer shown in Rgs. 1 and 2; 
30 Fig. 6 is adagram showing a typical configuration of an MPEQ1 real time encoder board 213 employed in the per- 
sonal computer shown in Fig. 5; 

Fig. 7 is a diagram shewing a slip recorder main window 301 ; 
Fig. 8 is a diagram shming a tape setting dialog box 321 ; 
Fig. 9A and 9B are diagrams used for explaining normal and endless tapes; 
35 Fig. 10 is a table showing specifications for a variety of video recording modes; 

Fig. 11 shows a flowchart representing a recording process wherein a nornrial tape has been set as a ta^ 
the recording process; 

Fig. 12 shows a flowchart representing a recorcfing process wherein an endless tape has been set as a tape used 
in the recording process; 

40 Fig. 13 shows a flowchart representing an index recording process to record index data in an index file; 
Fig. 14 is a diagram showing a typical format of index data; 
Fig. 15 is a diagram showing a playt>ack window 341; 

Fig. 16 is a diagram used for explaining a lapsing period of time, a remaining period of time and a recording point 
of time; 

45 Fig. 1 7 shews a flowchart representing a slip playback process; 

Fig. 18 is a Uock diagram used for explaining processing carried out by execution of a slip recorder application pro- 
gram; 

Fig. 1 9 is a diagram showing variatiorts of a scene change parameter with the lapse of time; 
Fig. 20 shows a flowchart representing processing carried out k>y a controller 133; 
so Fig. 21 is adiagram showing a dip editor main window 361 ; 

Fig. 22 is adiagram shewing an index (fispl^ level setting dialog box 381; and 

Fig. 23 shows a flowchart representing an index saeen displaying process for displaying index screens on a source 
window 362, Rg. 24 is a diagram showing a dip viewer main window 401 . 

55 DETAILED DESCRIPTION OF THE PREFERRED Eh/IBODIMENTS 

The present invention will become more apparent from a careful study of the fdlowing detailed descrf>tion of some 
preferred embodiments with reference to the accompanying diagrams. Before starting the description, in order to darify 
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the relation between a variety of means ccted in claims of the patent specification and the embocfiments. characteristics 
of the present invention are explained by appending an embodiment to each meare corresponding to the embocfiment 
as a phrase expressed in a form lmplemented typicaOy by an embodintenf enclosed in parentheses as follows. 
A picture processing apparatus for processing a picture according to daim 1 is characterized by compr^ng: 

5 

a computing means (implemented typtcaOy tyy an embodiment such as a processing step S34of a program shown 
in Fig. 13) for computing a scene change parameter representing a degree of a scene change in said picture: and 
a recording means implemented typically by an embodiment such as a processing step S36 of the program shown 
in Ftg. 13) for reconfing said scene change parameter and position information on a position of said picture with a 
10 degree of a scene change thereof represented by said scene change parameter by associating said scene change 
parameter with said position information. 

According to claim 2. a picture processing apparatus claimed as claim 1 is further characterized by also having: 

75 a threshold value setting means (irrplemented typically by an embocfiment such as an index deplay level setting 
dialog box 381 shown in Fig. 22) for setting a threshold value of said scene change parameter; and 
a display means (inplemented typically by an embodiment such as a source window 362 shown in Ftg. 21) for cfis- 
playing a screen of said picture at a positfon indicated by said position information associated with said scene 
change parameter representing a degree of a scene change equal to or higher ttian said threshold value set k>y 

20 using said tfireshold value setting means. 

According to claim 3. a picture processing apparatus dainYed as daim 1 is further characterized by also having: 

a scene change paramet^ count setting means (implemented typically by an embodiment such as the index cfis- 
25 play level setting dialog box 381 shown in Rg. 22) for setting a scene change parameter count; and 
a cfisplay means for dsplaying saeens Orrpleniemed tyFNcally t}y an 

shewn in Ftg. 21) of said pictures at positions indicated by pieces of said position information assodated with said 
scene change parameters representing highest degrees of scene changes wherein the number of screens to be 
displayed does not exceed said scene change parameter count set by using said scene change parameter count 
30 setting means. 

According to daim 4, a picture processing apparatus claimed as claim 1 is further characterized by also having: 

a range setting means (implemented typically by an embodiment such as the index display level setting dialog box 
35 381 shown in Rg. 22) for setting a range to be searched for a scene change parameter representing a highest 
degree of a scene change among scene changes in said range; and 

a display means (irrplemented typically by an embodiment such as the source window 362 shown in Rg. 21) for 
searching each range set by said range setting nfieans for a specif ic scene change parang 
est degree of a scene change among scene chariges in said range and displaying a saeen of said picture at a posi- 
40 tion indicated by said position information assodated with said specif tc scene change parameter. 

According to daim 5, a ^MCture processing apparatus claimed as daim 1 is further characterized by also having: 

a detection means (implemented typically l3y an embodiment such as a processing step S35 of the program shown 
45 in Fig. 1 3) for detecting a scene change parameter representing a degree of a scene change equal to or higher than 
a predetermined level; and 

a display means (implemented typically t>y an embocfiment such as a scene change incficator 303 shown in Fig. 7) 
for displaying detection of a scene change parameter representing a degree of a scene change ecfual to or higher 
than said predetermined level. 

50 

According to daim 7. a picture processing apparatus claimed as daim 6 is further characterized by also having an 
encoding means (implenDented typically by an embocfiment such as an MPEG1 real time encoder board 213 shown in 
Fig. 5) for encoding said picture to be recorded by said recording means. 

It should be noted that, of course, the embodiments appended to the mear« assodated with the embodiments are 
55 not intended to be construed in a Gmiting sense. That is to say. implementation of a means not limited to the embod- 
iment appended to the means. 

Figs. 1 and 2 are diagrams each showing a typical configuration of an embodiment implementing a personal com- 
puter to which the present invention is appfied. 
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As shown in the figures, the personal confer conrpr^es a main unit 31. a keyboard 21 as weO as a mouse 22 
operated by the user tor entering a corTYnand to the main unit 31 and a cfisplay apparatus 51 for (fisplaying a picture 

The main unit 31 is of the schcalled mini tower type with a typical width of 225 mm. a typicaJ height of 367.9 mm 
and a typical depth of 451.5 mm. A rig^ front comer surface 32 is provided between a front surface and a right side 
5 surface, diagonally crossing the corner between the front surface and the right side surfaca By the same tok^, a left 
front corner surface 33 is provided between the front surface and a left side surface, diagonally crossing the comer 
between the front surface and the left side surfaca At the upper portion of the right front corner surface 32. a power 
supply button 34 is provided. The paver siw^ txitton 34 is operated to turn on and off the power sipply of the main 
unit 31. 

10 A dent 35 s provided on the top surface of the main unit 31 at a position which will coincide with the feet of a periph- 
eral unit connected to the main unit 31 to be mounted thereon. When the per9)heral unit is mounted on the main unit 
31 . the feet of the peripheral unit are placed in the dent 35 so that the feet of peripheral unit are engaged with the dent 
31 of the main unit in a statile state. 

The front surface of the main unit 31 comprises a lower panel 36 and an ipper panel 37. The k)wer pand 36 is nor- 

IS mally pushed in the outmrd drection to protrude outward by a force of a spring not shown in the figura The user can 
press the kiwer panel 36 from the outwardly protruding state in a direction toward the inside of the main mit 31 to a 
dented stata resisting the force of the spring. The upper panel 37 can be moved up and down freely atong right and left 
guides 45. With the tower panel 36 in a protruding state, the motion of the upper panel 37 in the downward directkm is 
biocked by the kMver panel 3a 

20 When using the main unit 31 , the user presses the lower panel 36 from the outwardly protruding state in a direction 
toward the inskJe of the main unit 31 to a dented state, resisting the force of tfie spring. With the kswer panel 36 put in 
a dented state, the restriction of the motk>n of tfte upper panel 37 in the downward directkMi is removed, allowing the 
upper panel 37 to be sikied In the downward direction along the gukJes 45. As a result, an FDD (Ftoppy Disc Drive) 41 . 
a CD-ROM (Conpact Disc Read-Only Memory)/CD-R (Conpact Disc Recordable) drive 42 and an AV (Audk> Visual) 

25 temfiinal unit 43 entbedded in the main unit 31 are put in a state exposed to the user as shown in Rg. 2. The CD-ROM 
(Corrpact Dtsc Read-Only Memor^/CD-R (Compact Disc Recordable) drive 42 is referred to hereafter simply as a CD 
drive. 

It shouM k>e noted that the main unit 31 also has an extensbn unit 44 for alkiwing other predetemuned apparatuses 
to be installed thereon. 

30 When the use of the personal computer is finished, the user puts a finger thereof on a dent 38 aeated on the upper 
portion of the upper panel 37 and moves the upper panel 37 in the upward direction. As the ipper panel 37 moves in 
the upward directton along the guMes 45, reaching a predetermined position, the lower panel 36 is restored to the out- 
wardly protruding state by the force of the spring. In thte state, the motion of the ipper panel 37 in the downward direc- 
tum is again bkxiked by the kswer panel 36. 

35 As descrS>edabova the right frorrt comer surface 32 and the 1^ front comer surface 33 each having a taf^ 

are provided on the comers between the right skfe surface and the front surface and the left skJe surface and the front 
suriace respectively in order to make the wkfth of the main unit31 k)oks narrow. In additkm, the upper panel 37 prosnded 
as part of the front surface of the main unit 31 can be sIkJed freely and serves as a protector of devk^esacconrimodated 
in the main unit 31. When the personal computer is not used, the upper panel 37 is put in a state of conceafing the 

40 accommodated deinces by putting them in an unexposed state. As a result, a flat and simple design image can t>e 
implemented. 

Taking the potential applKation to the future AV equipment, the upper panel 37 is designed so that it can be modi- 
fied into a drawer or rotary typa 

Bask»lly, the display apparatus 51 corTprisesabase52andadisplay unit53whk:h isprovkledinsuchawaythat 
45 it can be freely moved in the horizontal directkm (pan direction) and the vertk^al directkm (tilt direction) with respect to 
the base 52. On the front portbn of the base 52, a dent 54 is provided. 

As the front surface of the display mit 53. a CRT (Cathode Ray Tube) 55 is provkled. The CRT 55 serves typk:ally 
as a high precisbn 17-inch trinitron monitor. On the right front comer between the right skie surface of the display unit 
53 and the CRT 55, a right front corner surface 56 having a taper shape is provkled. On the inner skie of the right front 
so comer surface 56, a tower speaker 59 and an upper speaker 60 are provkied. By the same token, on the left front corner 
between the right skJe surface of the display unit 53 and the CRT 55. a left front caner surface 56 having a taper shape 
is also provkied and. on the inner skie of the left front comer surface 57. a tower speaker 59 and an upper speaker 60 
are provkied as well. With such components provkied. reproductton of a high quality pictiffe and toud high quality stereo 
sound can t>e realized. 

55 On the front portton of the top of the cfisplay unit 53. a microphone 24 is provkied. The mtorophone 24 is used for 
Inputting votoe of the user. In conjirotion with the speakers 59 and 60, the rrucrophone 24 can be used for implement- 
ing, for exampla a hands free phona 

At the center of the top of the display unit 53, a groove 58 is provkied. The groove 58 is used for accomnKXlating a 
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cord Of the microphone 24. When a telev^on cam^ 

the cord of the television camera can also be accommodated in the groove 58. 

Rg. 3 is a diagram showing a typical detaOed configuration of the front surface of the main unit 31. 
As shown in the figure, a power sif^ply lamp 61 is provided at)Gve the power SLf)ply button 34 desaa>ed earlier. 
5 The power SLspffy lamp 61 lights up to indicate that the power supply has been turned on. When the power sipply is 
off, on the other hand, the power si^sply lamp 61 dies out Beneath the power supply button 34, a hard dsc access lanp 
63 6 provided. As will be described later, the main unit 31 has an embedded hard disc 21 2 as shown in Fig. 5. When 
an access is being made to the hard disc 21 2, the hard cGsc access larrp 63 lights up. TypicaOy, the hard disc access 
lamp 63 has an orange odor. 

10 TTie FDD 41 is typically a driver for 3.5-inch FD with a storage capacity of 1 .44 MB (megabytes), 1 .2 MB or 720 KB 
(kilobytes). On the front surface of the FDD 41 , a floppy disc drive access lamp 64 and a floppy disc ir^ ect button 66 are 
provided. The floppy d^ drive access lamp 64 Bghts up when an access is being made to an FD mounted on the FDD 
41. The user presses the floppy disc inject button 66 to take out an FD from the FDD 41. 

The CD drive 42 reads out data from a CD-ROM disc not shown in the figure and reads out or writes data from or 

IS into a CD-R (CD-R FS) disc 21 1 shown in Fig. 5. It should be noted that the CD drive 42 typicaOy reacte out data at an 
d-ta'me speed and writes data at a double speed. 

On the front surface of the CD drive 42, an eject button 68. an eject hole 69 and an access larrp 70 are provided. 
The eject button 68 is operated to draw a tray of the CD drive 42. The eject hole 69 is operated in case the tray can not 
be drawn by pressing the eject button 68. That is to say, a stick with a sharp end is introduced into the eject hole 69 to 

20 draw the tray. The access larrp 70 lights up when an access is being m^ mounted 
on the CD drive 42. 

The AV terminal unit 43 comprises an S vkieo input terminal, a video input terminal for a conposite signal and 2 
audk> Input temrnnals (pin jacks) for L Geft) and R (right) channels. Pictures and sound recorded by a video camera or 
a VTR (Video Tape Recorder) to be edited by ths personal corrputer are entered through ttie terminals of the AV ter- 
25 minal unit 43. 

Fig. 4 is a diagram showing a typk:al detaOed configuration of the rear suriace of the main unit 31. 

At the right upper comer of the rear surface of tfie main unit 31. a power supply input terminal 71 is provided. A 
power sipply cord not shown in the figure is connected to the power supply input terminal 71 to supply power to the 
main unit 31. 

30 At the left upper corner cf the rear sivface of the rnain unit 31. a k^boardtemriin^ 

provided. The keyboard terminal 72 and the vnouse terminal 73 are connected to the keyboard 21 and the mouse 22 
respectively. Beneath the mouse terminal 73, a USB (Universal Serial Bus) terminal 74 is provided. The USB terminal 
74 is used for connecting an apparatus confonnng to USB specif icatbns to the main unit 31 . Betow the USB terminal 
74, a printer terminal 75 and 2 serial terminate 76 are provided. The printer terminal 75 is connected to a printer or an 

35 Image scanner. Typk^ally, an infrared communication adapter is connected to one of the serial tenninals 76. That is to 
say, in tNs embodiment by connecting one of the serial terminals 76 to an infrared adapter which senses as an infrared 
confvnunkation interface, infrared cormuinicatk>n can be implemented between the main unit 31 arxJ another appara- 
tus. 

Beneath the printer terminal 75. a game terminal 77 is provided. The game terminal 77 e connected typically to a 
40 joy stick or a MIDI (Musk^ Instrument Digital Interface) apparatus. 

Below the serial tenminal 76, a headphone terminal 78, a line input temmnal 79 and a mk:rophone terminal 80 are 
provided one beneath another in an order they are enumerated. Typically, the headphone terminal 78, the line input ter- 
minal 79 and the mk^ophone terminal 80 are connected respectively to an external speaker, an audk> apparatus arxJ 
the microphone 24 shown in Figs. 1 and 2. 
45 n shouki be noted that, on the right skle of each of the tenminals descrft>ed above. pk;tures are shown to indk;ate 
what devk^e or apparatus is to be connected to the terminal. 

Betowthe mk:rophone tenminal 80, a vkJeo output terminal 81 for a conposite signal, an S video output terminal 
82 and a monitor terminal 83 are provkled. A composite vkJeo signal and an S video signal are output from the vMeo 
output tenminal 81 for a composite signal and the S video output temtinal 82 respectively The monitor terminal 83 is 
50 connected to the display apparatus 51. 

Beneath the vkieo output terminal 81 for a corrposite signal, the S video output terminal 82 and the nfK3nitor termi- 
nal 83, an AV terrranal unit 84 is provided. Much like the AV terminal unit 43 on the front surface, the AV terninal unit 
84 comprises an S vkleo input terminal, a video input terminal for a composite signal and 2 audio input terminals for the 
L and R channels. 

55 On the right skle of the AV terminal unit 84. an antenna terminal 85 is provkled, altowing a televisk>n signal typk^ally 
in a VHF (Very Mgh Requency) band and in a UHF (Ultra High Requency) band to be received. 

On a further lower part of the rear surface of the main unit 31 , a line jack 86 and a telephone jack 87 are provkied. 
The line jack 86 is connected to a telephone line and the telephone jack 87 is connected to typically a telephone set or 
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a facsimOe apparatus. 

Rg. 5 is a diagram shewing a typical electrical configuration of the personal connputef shown In Rgs. 1 and 2. 

In this enrtxxliment the personal conputer is provided with an ent>edded MPEG1 (Moving Picture Experts Group) 
real time encoder board 21 3 which In turn has an embedded TV (Television) tuner 213A. The personal computer s also 
5 provided with appGcation programs as a standard for carrying out editing, recording, reproduction as well as MPEG 
decocfing of pictures and other picture processing. The MPEG1 real time erKoder board 213 and the application pro- 
grams allow the ecfiting of pictures and sound taken by a video camera 214, the aeation of a video CD for recording 
pictures and sound obtained as a result of the editing and other processing to be canied out with ease. In addition, a 
television broadcast program received by the TV tuner 21 3A can also be recorded with ease and other processing can 
10 be carried out easily ^ well. On the top of that whDe a teleinston broadcast program received by the TV tuner 213A is 
being recorded, any artjitrary scene of an already recorded video signal or pictures can be played back with ease. 

To put it in detail, a miaoprocessor 201 carries out eciting. recording, reproduction as well as MPEG encoding of 
pictures and other predetermined picture processing by execution of a variety of application programs stored in the hard 
disc 212 under control of an operating system such as Windows 95 (tradeni^ made tiyMicrosoftwhich is also stored 
15 in the hard disc 212. As the microprocessor 201 . the Pentium II processor of Intel witti a frequency of 266 MHz and an 
embedded secondary cache memory of 512 KB not shewn in the figire is employed. The Pentium II processor is the 
Pentium Pro processor also made by Intel with an MMX technology and a facility to generate optimized 16-brt code 
added thereta Prcvided with such a processor, the personal oorrputer is capable of displaying a high performance even 
when processing a large amount of picture and sound data. It should be noted that Pentium and MMX are trademarks. 
20 A ntainrrienriory unit 202 is used for Storing a program to be executed by 

in operations carried out t>y the nicroprocessbr 201 . As a standard, the main nDemory unit 202 has a storage capacity 
of typically 32 MB which aOows processing of. for example, a picture with a large amount of data to be carried out at a 
high speed. It shouM be noted that the borage capacity of the main memory unit 202 can be increased up to typically 
128 MB by memory extension. 

25 A bus bridge 204 controls exchanges of data between an imernal bus and an extension bus such as a PCI 
eral Component Interconnect) local bus or an ISA (Industry ^andard Architecture) bus. 

The miaaprocessor 201. the main memory uiit 202 and the bus bridge 204 are connected to each other by the 
internal bus. On the other hand, the remaining bkxks are connected to each other by the extensk>n bus. It should be 
noted tfiat the txist>ridge 204 is connected to both the internal bus and the extension bus. 

30 As a nrwdem 206. a 33.6-Kbps (bits per second) DSVD/DATA/FAX modem is employed. The modem 206 controls 
comnunication through a telephone line. The modem 206 receives a picture and sound from a source such as the Inter- 
net to be subjected to processing such as encoding and editing. On the other hand, the nxxiem 206 is also capable of 
transmitting a picture and sound completing processing such as encoding and editing to an external destination. In 
addition, the rrxxlem 206 transmits sound input tlvough the microphone 24 and receives incoming sound to output to 

35 the speakers 59 and 60. allGwing a hands free phone to be implemented. It shouM be noted that when the modem 206 
is used as a FAX modem, the transfer rate is set at 1 4.4 Kbps 

An yO (input/butput) interface unit 207 generates an operation signal representing an operation canied out by the 
user on the keyboard 21 or the mouse 22. In addition, the I/O interiSace unit 207 also functions as an imerface for receiv- 
ing an electrical signal as an audbsi^ output by the microphone 24. 

40 An auxiliary storage interface unit 210 functions as an interface of reading out and writing data from and onto 
recording media such as the CD-R (Compact Disc Recordable) disc 21 1 , a CD-ROM disc not shown in the figure, the 
HD (hard disc) 212 and an FD ateo not shown in thefigura 

On the CD-R disc 21 1 , pictures and sound encoded by the MPEG1 real time encoder board 21 3 is stored, allowing 
a user original video CD to be made. It should be noted that the CD drive 42 is also capable of handling a CD-R FS 

45 disc. Data Of up to about 650 MB can be Stored in the CD-R disc 211 whereas a CD-R FS disc is c 
of up to only about 520 MB. 

The hard disc 212 has a typical staage capacity of 4.3 GB(gigabytes) which is capable of keeping up with a high 
speed bus m^er IDE (Integrated Drive Electronics) transfer. The hard disc 212 is used for storing typk»lly data 
obtained as a result of compression and encoding carried out by ttie MPEG1 real time encoder board 213 and data 
50 required in processing carried out by the microprocessor 201. It should be noted that the main unit 31 is designed to 
allow an SCSI (Small Computer System Interface) board to be installed therein. With the SCSI board instaHed. a hard 
disc drive having an SCSI interface can be added. 

In addition, the hard disc 212 is also for storing an opmting system as well as software including application 
programs to be executed by the microprocessa 201 to carry out processing such as recording, reproduction, editing 
55 and decoding of pictures. 

As an appGcation program for the so-called vkJeo aeation through processing such as recording, reproduction and 
editing of pictures, a software caUed Slipdip is installed. 

The SIpc&p software comprises 5 application programs called as a Slip recorder, a dip editor, a dip viewer, a video 
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CD aeator and a video CD copy tod. 

The ^ip recorder is executed to record a picture and sound or to play backa recorded picture and sound. The dip 
editor is eoecuted to ecfit a recorded picture and its acconrpanying sound. The dip viewer is executed to administer 
recorded pictures and sound. A video CD creator is executed to record an edited picture or other data onto a CD-R dsc 
211 in order to make a video CD. The video CD copy tool is executed to make a copy video CD of a video CD made 
earlier. 

It should t>e noted that, in the present enrtodiment. only a picture obtained as a result of editing work done in the 
main unit 31 can be copied in order to prevent a so-called pirate dsc from being made DIegally. 

Among the sip recorder, the dp edrtor. the dp viewer, the video CD aeator and the video CD copy tod. only the 
sGp recorder, the dip ecfitor arxJ the dip viewer relate to recording, reproduction and ecfiting of a ptoture in partkxdar and 
wiD be explained one after artother later. 

In the hard disc 212. there is further stored an application program to be executed by the microprocessor 201 to 
decode data encoded by the MPEG1 real time encoder board 213 typically in confbrmrty with MPEG1 specifications. 
Thi^ in this case, a picture is encoded by hardware and decoded by software ttshouMbenotedthatapkrturecanalso 
be encoded by software and decoded t)y hardware. 

The encoder board 213. strictty speaking, the MPEG1 real time encoder board 213. encodes a picture and sound 
in a real time manner typically in corrfomrirty with the MPEGl specifications. To be more spedftc. the MPEG1 real time 
encoder board 213 iscapat)le of encoding a picture and sound in 4 different video recording modes including a mode 
of encoding at a Ngh bit rate ior high quality picture recording and a mode of encoding at a low bit rate for transmission. 
As will be described later, enumerated in an order of deaeasing bit rates, the video recording modes are "High'. "Nor- 
mal". "Long" and "Network". It shoukJ be noted that the normal video recording mode conforrrs to video CD specifica- 
tions. When pictures arxl sound are ertooded in this video recording mode, recording of atxxjt 100 minutes per 1 GB 
can be carried out 

As described atxsve, the MPEG1 real time encoder board 213 has an embedded TV tuner 213A for receiving a tel- 
evsion broadcast program. A program received by the TV tuner 213A is subjected to MPEG encoding in the MPEG1 
real time encoder board 21 3. In addition, the MPEG1 realtimeencoderboard213isalsocapableof encoding data sup- 
plied thereto t>y way of the extension bus. data stppfied thereto by way of the AV processing drcuit 215 and data sup- 
plied thereto from an external apparatus such as the vkieocantera 214. An exarrple of ^ thereto by way of 
the AV processing circurt 215 is a picture played back by the VTR 216. 

It shodd be noted that the TV tuner 213A allows typically 62 channels, from Channel 1 to Channel 62. to be 
selected. As for its aucfio fadlrty. stereo and bOingual programs can be received. 

The video camera 214 used typically for taking a picture to be supplied to the MPEG1 real time encoder board 
213. It shouW be noted that the MPEG1 real time encoder board 213 also has a function for interfadng with the video 
camera 214. allowing a pkmire and sound taton by the video camera 214 to be supplied to the MPEG1 real time 
encoder board 213. 

The AV processing circuit 215 comprises corrponents induding a VGA (Video Qraphk; Anay) and a adimenstonal 
accelerator which are not shown in the figure The AV processing drcuit 21 5 cam'es out processing required for display- 
ing graphics and other information on the display apparatus 51 . In addition, the AV processing circuit 215 also cam'es 
out processing required lor outputting sound to the speakers 59 and 60. The AV processing drcuit 21 5 has an embed- 
ded NTSC encoder 215A which is used for converting a picture into one conforming to the NTSC system before output- 
ting the picture to typkally the VTR 216. 

The AV processing drcuit 215 is connected to the MPEGl real time encoder board 213 typteally by an AMC bus. 
The MPEG1 real time encoder board 213 is designed so that a picture subjected to MPEG encoding is once stored in 
a frame memory unit 110 shown in Fig, 6. The frame memory unit 110 will b6descrit)ed more later. When an instruction 
to monitor a picture sut)jected to MPEG encoding is received, ftre picture is re^ out from the frame memory unit 110 
and sipplied from the MPEG1 real time encoder board 213 to ttie AV processing drcuit 215 by way of the AMC bus. 
The AV processing drcuit 21 5 then dsplays the pk;ture on the display apparatus 51. 

To put it in detaD. the AV processing drcuit 21 5 draws a drawing on a VRAM (Video RAM (Random Access Mem- 
ory)) unit 203 and outputs the drawing to the display apparatus 51 . 

The VTR 216 records pictures and sound output by the AV processing drcuit 215 if necessary. 

Fig. 6 ^ a diagram shewing a typical configuration of the MPEGl real time encoder board 213 employed in the per- 
sonal computer shown in Fig. 5. It should be noted that Fig. 6 shows only blocks relating to MPEG encoding. Other 
blocks such as Uocte constituting the TV toner 213A are omitted from the figure. Speaking more strictiy. Rg. 6 shows 
only blocks relating to MPEG encoding of a pictura Blocks relating to MPEG encoding of sound are also omitted from 
the figure. 

Digital picture data of 1 frame conposed of a predetermined number of pixels is supplied to an input terminal 101 
at a typkal transfer rate of about 30 frames per second. 

Picture data supplied through the input tenninal 101 is terrporarily stored in the memory frame unit 1 10 which is 
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capable of storing a pturaSty of frames of picture data, typically. 27 frames of picture data, so that ttie frames can be 
rearranged into a predetermined order. The picture data is then sif)plied to a block cfivider 111 and a motion detector 
120. The block (fivider 1 1 1 divides a frame of the picture date supplied from the memory frame unit 1 10 into luminance 
conponents of typtcaily 8 X 8 pixels and blocks of chronra conrponents Cb an^ 
5 of 6 blocks, namely, 4 luminance component blocks and 1 Cb chroma component block as well as 1 Or chroma conrpo- 
nent block wfiich are associated with the 4 luminance component bk>cks. 

The block divider 111 suppliesthe picture data to a subtractor 112 in rnacroblock units. The subtracter 111 com- 
putes a difference betwe&i the picture data supplied by the block cfivider 1 1 1 arxl Interframe precficted picture data to 
bedescrbed laterandsuppBesthedrfferencetoaswitched ternmnalbof achange^iverswitch 11^ 

10 subjected to interframe predictk)n encoding ateo to be described later. On the other hand, picture data output by the 
block divider 1 1 1 is supplied to a switched terminal a of tfie change-ov^ switch 1 13 as data of a frame subjected to 
intraframe prediction encocfing also to be described later. 

The changeKiver switch 113 selects either the switched terminal a or b and picture data supplied to the selected 
switched tenmlnal is passed on to a DOT (disaete cosign translbnnation) circuit 1 1 4 in block units. The DOT droit 1 1 4 

IS carries out DOT processing on picture data passed on thereto and outputs a DOT ooeffidentobt^ 

DCT processing to a quantizer 1 1 5. The quantizer 1 1 5 quantizes the DCT coefficient si4)plied thereto by the DOT circuit 
1 1 4 at a predetermined quantization step and outputs a quantized coeff ident obtained as a result of the quantization to 
a zigzag scan circuit 116. 

The zigzag scan drcurt 116 carries out zigzag scanning on quantized coeffidents of each block and outputs the 

20 scanned coeffidents to a VLC (Variable Length Code) circuit 1 17 in the scanning order. The VLC circuit 1 17 carries out 
VLC processing on the quantized coeffidents supplied thereto bf the zigzag scan drcuit 1 16 and supplies variable 
length encoded data obtained as a result of tiie VLC processing to an output buffer 118. The output buffer 1 18 has a 
storage capacity of typk;ally 160 KB. By temporarily storing the variable length encoded data received from the VLC dr- 
cuit 117, the output buffer 118 carries out a function of rnainlysrTUX>thing of the anr^ 

2s terminal 102. Data appearing at the output tenmlnal 102 is sipplied typically to the hard disc 212 to be stored therein. 
In addition, the output txjffer 118 also supplies information on the amount of data stored tenporarily therein to a 
quantization step controller 119. The quantization step controller 119 sets the quantization step at such a value that nei- 
ther overfk3w nor underftow occurs in the output buffer 118 and outputs the value of the quantization step to the quan- 
tizer 1 15. As described above, the c^jantizer 1 15 quantizes a DCT coeffldent stppfied thereto by the DCT drcuit 114 

30 at a predetermined quantization step, that Is, a quantization step supplied by the quantization step controller 1 1 9. 

On the other hand, the quantizer 115 also supplies a quantized coeffident to an inverse quantizer 126 in addition 
to the zigzag scan drcuit 1 16 described above. The inverse quantizer 126 carries out Inverse quantization on tiie quan- 
tized coeffk:ient supplied by the quantizer 115 and suppBes a DCT coeffident obtained as a result of the inverse quan- 
tization to an Inverse DCT drcuit 125. The inverse DCT drcuit 125 carries out inverse DCT processing on the DCT 

35 coeffident and outputs data obtained as a result of the Inverse DCT processing to an adder 1 24. Also supplied to tfie 
adder 124 is interframe predicted picture data supplied by a motion corrpensator 121 by way of a turned on change- 
over switch 123 which is turned on when a frame ^ected to Interframe predictk>n encoding is processed. The adder 
1 24 adds the data output by the inverse DCT drcuit 125 to the interframe predicted picture data supplied by the motion 
conrpensator 121 and outputs the sum to a frame memory unit 122. 

40 Thenrxitionconrpensator 121 conpensates data stored in the franra nrienrK>ry unit 122 for a nrx^^ 

with a motion vectn- output by the motion detector 120. Interframe predicted picture data obtained as a result of the 
compensation is supplied to the subtractor 112 as descrft>ed eariier and the change-over switch 123. 

Frames corrposing a pkAjre, strictty speaking, a moving picture, to be encoded are arranged in a display order 
starting with the head as folk)ws: 10, B1, B2, P3, B4, B5, P6, B7. B8. 19, BIO, B11, B12, — . The symbols I. P and B 

45 indicate that frames denoted thereby are an 1 picture, a P pnture and a B picture respectively and a number appended 
to a syrrtx)! indicates a position in the display order. 

In the MPEG system, first of all, a pk:ture K) is encoded. Then, a picture P3 is supposed to be encoded. In this case, 
however, instead of encoding the picture P3 itself, a difference between the pictures P3 and H) is encoded. Subse- 
quentty, a picture B1 is supposed to be encoded, however. Instead of encoding the pkrture B1 itself, a cBfference 

50 between the pictures B1 and 10 or P3 or a difference between the picture B1 and an average of the pictures 10 and P3 
is encoded. In this case, one is selected among the picture 10. the pKture P3 and the average of the pictures 10 and P3 
so tfiat a so-called predicted residual obtained as a result of the encoding is minimum. That is to say, the encoding of a 
drffererK^e between ttie picture B1 and the selected one results in data with a minimum anK>unt. 

After ttie encoding of the picture B1 , a picture B2 is sufsposed to be encoded, however, instead of encoding ttie pic- 

55 ture B2 itself, a difference b^een the pictures B2 and 10 or P3 or a difference between ttie picture B2 and an average 
of the pk:tures 10 and P3 Is encoded. In ttits case, one is selected among ttie picture 10, the picture P3 and ttie average 
of ttie pkrtires 10 and P3 so ttiat ttie soK^alled predicted residual obtained as a result of the encoding of a cfifference 
between ttie picture B2 and ttie selected one results in data witti a minimum amount. 
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Subsequently, a ptctu-e P6 ts supposed to be encoded, however, instead of encoding the picture P6 Hsetff, a differ- 
ence between the pictures P6 and P3 is encoded. Thereafter, encoding Is carried out by following the same procedure. 

A picture supposed to t>e encoded and a partner picture whose dfference from the picture supposed to be encoded 
is actually encoded form a pair. Such pairs are listed in the following table in an encoding order. 



Encoding order 


Picture to be encoded 


Partner picture 


1 


10 


- 


2 


P3 


IOorP3 


3 


B1 


10 orP3 


4 


B2 


10 orP3 


5 


P6 


P3 


6 


B4 


P3orP6 


7 


B5 


P3orP6 


8 


P9 


P6 


9 


B7 


P6orP9 


10 


B8 


P6orP9 


11 


19 




12 


P12 


19 


13 


BIO 


l9orP12 


14 


B11 


l9orP12 



As shown in the above table, the encoding order Is 10, P3, B1, B2, P6. B4, B5, P9. B7. B8, 19, P12, BIO, B1 1 , — 
and. thus, different from the display order. Data after the encoding Is output In such an order. 

It should be noted that in the case of a P picture or a B picture, as described above, It is normal to encode a differ- 
ence between the P picture or the B picture from another picture. If the amount of data obtained as a result of the encod- 
ing of the picture Itself Is smaller than that obtained as a result of encoding the difference, nevertheless, the picture itself 
is encoded. 

In the MPEQ1 real time encoder board 213 shown in Rg. 6. encoding is earned out as described above. 

Thus, in an operation to encode the first picture 10, data of the picture is read out from the frame memory unit 1 1 0 
and supplied to the blockdivider 111 to be divided into blocks. To be more specific, the data of the picture is divided by 
the block divider 111 In a bk^king process Into the 4 luminance bk)cks and the Cb and Cr chrominance blocks 
described earlier which are output sequentially one tkxk after another. In an operatbn to encode an I picture, the 
change-over switch 113 is set at the switched temninal a. Thus. pKturedataoutputbythe blockdivider 111 issuppGed 
to the DOT drcuit 1 14 t>y way of the change-over switch 1 13. In the DOT circuit 114, picture data supplied thereto in 
block units is subjected to vertical horizontal 2 dimensfonal DOT processing. As a result, picture data on the time axis 
Is converted into DOT coefficients of data on a frequency axis. 

The quantizer 115 quantizes a DOT coefficient supplied thereto t>y the DOT circuit 1 1 4 at a quantization step deter- 
mined tjy the quantization step controller 119 and outputs a quantized coefficient obtained as a result of the quantiza- 
tion to the zigzag scan circuit 1 16. The zigzag scan circuit 1 16 carries out zigzag scanning on quantized coefficients of 
each bk)ck and outputs the scanned ooeff ictents to the VLC circuit 1 1 7 in the scanning order. 

The VLC circuit 1 1 7 carries out variable length coding processing such as Huffman cocGng on the quantized coef- 
ficients supplied thereto t>y the zigzag scan circuit 1 16 and supplies variable length encoded data ot^tained as a result 
of the variable length coding processing to the output buffer 118 to be stored therein terrporarily. Then, the variable 
length encoded data Is output by the buffer 118 at afixed bit rate. Thus, the output buffer 118 plays the role of a so- 
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caOed buffer memory aDcwirtg data generated irregularty to be output at a fixed bit rata 

As descra)ed above, the picture 10. an I (intra) picture, is encoded alone without involving other pictures in the 
encocfing. Such encocfing of a picture alone without involving other pictures is referred to hereafter as intraframe encod- 
ing. It should be noted that a picture completing intraframe encoding is decoded in accordance with a reversed proce- 
5 dure opposite to the procedure descri>ed at>ov& 

Next, the encoding of the second picture P3 is 6&safbed. The second and subsequent pictures can also be 
encoded as an I picture. By doing so, however, the compression ratio of the encoding will be low. In order to solve thm 
problem. ub'Bzing the fact that correlation among consecutive pictures exi^ the second and subsequent pictures are 
encoded as follows. 

10 The motion detectcn- 1 20 detects a portion of the first picture 10 that well res&Mes one of macroUocte composing 
the second picture P3 for each of the macroblocks. A vector representing a shift in positional relation betwe^ a mac- 
roblock and a portion that well resembles the macroblock is detected as a motion vector. Described in documents such 
as the ISO/ISC 1 11 72-2 annex D.6.2. the method of detecting a motion vector is not descrft)ed in this specification. 
As for the second picture P3. instead of supplying its blocks to the DOT circuit 11 4 as th^ are. a difference between 

IS a P3 block and a bk>ck obtained from the first picture 10 as a result of motion compensation carried out by the motion 
corrpensator 121 in accordance with a rnotion vector of the block is corrputed by the subtract 
suppfiedtothe DCTdrcuit 114by way of thechange^erswitch 113. 

In this case, if the correlation between a block obtained as a result of motion compensation of the first picture K) in 
accordance with a motion vector and a bkxk of the second picture P3 Is good, the difference between ttie blocte is 

20 small. In this case, the amount of data obtained as a result of encoding the difference is smaller than the amount of data 
obtained as a result of intraframe encoding of a block of the second picture P3. 

The technique of encoding a differerKe between bk>cks is referred to hereafter as irtterframe encoding. 
It shouM be noted, hcwever, that the amount of data obtained as a result of interframe encoding of a difference 
between 2 blocks is not always snrialler than the arnountcl data obtained as a result of ^ encoding. Depending 

25 on the conrplexity of a picture being encoded and the degree of correlation t>etween a frame and an immediately pre- 
ceding frame, the amount of data obtained as a result of interframe encoding of a cGfference t>etween 2 bkx:ks may be 
adversely larger than the amount of data obtained as a result of intraframe encoding, resulting in a higher compres6k>n 
ratio for the latter encoding. In such a case, the intraframe encoding is prefened and implemerrted instead. A decisk>n 
as to whether irrterframe encoding or intraframe encoding is to be carried out can be made for each macroblock. 

30 By the way. in order to carry out interframe encoding, that is. in order to find a difference between a current picture 
and the picture immediately preceding the current picture, it is necessary to find in advance a locally decoded immedi- 
ately preceding pteture obtained by kx:ally decoding encoded data of the immediately preceding pictu'e which has been 
encoded previously as wOl bedescn'bed below. 

For this reason, the MPEG1 real time encoder tx>ard 213 is provided with the so-called local decoder which com- 

35 prises the motion compensator 121. the frame memory unit 122. the change-over switch 123, the adder 124, the 
inverse DCT circuit 1 25 and the inverse quantizer 126. It should be noted that picture data stored in the frame memory 
unit 122 is called a k)cal decoded picture or local decoded data. On the other hand, picture data before coding is called 
an original picture or original data. 

In an operation to encode the first pk;ture 10, data output by the quantizer 1 1 5 is also locally decoded by the inverse 

40 quantizer 126 in corijunctbn with the inverse DCT circuit 125. In this case, the change-over switch 123 is tumed off, 
causing the k)cally decoded data tobe passed on t>y the adder 124 as it is to the frame rnernory unit 122. Th^ 
with the change-over switch 1 23 tumed off, tfie adder 1 24 in essence does not carry out addition on the locally decoded 
data. 

It should be noted that the picture data stored in the frame memory unit 1 22 is not an origpnal picture but a picture 
45 Obtained as a result of encodng the original picture and th^ locally decoding data obtained as a result of the brooding 
of the original picture. Thus, the picture data stored in the frame memory unit 122 is the same as apkrture obtained as 
a result of decodng carried out by a data decoding apparatus. Obtained as a result of encoding the original picture and 
then locally decoding data obtained as a result of the encoding of the original picture, the pkAjre data stored in the 
franrie rnenrrary unit 122 has a picture quality poaer than the original data to a ce^ 
so With locally decoded data of the first picture 10 stored in the frame memory unit 1 22. the second picture P3 is stp- 
plied from the frame memory unit 110 to the suftTtractor 112 by way of the block divider 111 in block units. It should be 
noted that, by this point of time, it is necessary to end the detection of motion vectors of the picture P3 carried out by 
the motion detector 120. 

On the other hand, the motion detector 120 supplies a motion vector detected for each macrobk)ck of the second 
55 pictiffe P3 to the motion conrpensator 121. The motion coirpensator 121 carries out MC (motion corrpensation) on the 
already locaDy decoded picture K) stored in the frame menrKxy unit 122 in accordance with a motion vector supplied by 
the motion detector 120. 1 rnacrobkx^k of MC(rnotion compensation) data obtained as a resutt of the rrxiti 
satlon is supplied to the subtracta 1 12 as interfranw predicted picture data. 
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The subtracter 1 1 2 computes a diff^ence between the 0^^ 
through the block divider 111 and the corresponding pix^ of the interfranne predicted picture data sifsplied by the 
motion compensator 121 for each pixel. The difference computed by the subtracter 112 is suppBed to the DOT circuit 
114 by way of the cfiange-over switch 113. Thereafter, thedrffer&x^ is subjected to encoding in the sanrte way as an I 
5 pictira Thus, in this case, the changeKiver switch 113 is set to the switched 

As described abcve. in the case of a P (predicted) picture, that is. in the case of the picture P3 in the above exam- 
ple, basically, an I or P picture encoded right before is used as a reference picture to which motion compensation is 
applied to produce a predicted picture, and a difference between the predicted picture and the P picture is then 
ertcoded. 

70 Thatis to sayjn the cased a P picture, for a macroblocK strictly spealdng, an interfr^ 

amount of data obtained as a result of interframe encoding is smaller than that obtained as a result of intraframe encod- 
ing, the change-over switch 1 1 3 is set to the switched terminal b in order to implement the interframe encoding. For a 
macrcblocK strictly speaking, an intraframe macroblock. for which the amount of data obtained as a result of intraframe 
encodng is smaller than that obtained as a result of interframe encoding, on the other hand, the chang&over switch 

75 113 is set tothe switched terminal a in order to irrplement the intraframe encoding. 

HshoukJbenotedthatarnaaobfockofaPpkrturethathascorrpletedintrafranra encoding is focally decoded and 
the focally decoded data is stored in the frame memory ur^ 1 22 in the sante way as an I pictura On the other hand, a 
macrobfock of a P picture tfiat has oonrY)leted interframe moding is locally decoded by adcfition of data passing 
through the inverse quantizer 1 26 and the inverse DOT circuit 1 25 to interframe predicted pfoture data from the nxition 

20 corrpensator 121 passed on by the tumed-on change-over switch 123 by mear^ of the adder 124. The focally decoded 
data output of the adder 124 is then stored in the frame memory unit 122. 
Next, encoding of the third picture B1 is explained. 

In an operation to encode a Bpfoture. namely, the picture B1 in this case, the motion detector 120 detects 2 motion 
vectors with respect to an I or P picture cGsplayed right before and an I or P picture displayed right after. Thus, in this 
26 exanrple. 2 motion vectors of the picture B1 with respect to the pictures 10 and P3 are detected. The motion vector with 
respect to the picture 10. an I picture displayed rigtit before the picture B1 . is referred to as a forward vector. On the other 
hand, the rnotion vector with respect to the picture P3, an Ppictore displayed right after the ^ 
a backward vector. 

The pfoture B1 is encoded by encoding one selected from the following 4 pieces of data whfoh will result in a small- 
30 est amount of encoded data. The 4 pieces of data are: 

1 A difference between the pfoture B1 and interframe precficted picture data obtained as a result of motion compen- 
sation of the locally decoded picture K) according to the forward vector. 

2 A difference between the picture B1 and interframe precOcted picture data obtained as a result of motion compen- 
35 sation of the focally decoded picture P3 aocorcfing to the t>ackward vecta. 

3 A difference between the pictured B1 arvl the average of the 2 pieces of interframe predicted picture data in 1 and 

2. 

4 The picture B1 itself. 

40 When differerKe 1, 2 or 3 is encoded, that is. when interframe encoding is carried out necessary motion vectors 
are supplied by the motion detector 1 20 to the motion compensator 1 21 . Interframe predicted pfoture data obtained as 
a result of niotfoncorrpensatfon carried out by the rnotion corrpensator 12 according to the motion vector is suppGed 
to the siditractor 112 which then coriputes the difference t>etween the orig^ and the interframe 

predicted picture data suppGed t>y the motion compensator 121. The cfifference is supplied to the DOT drcuit 1 14 by 

45 way of the change-over switch 1 13. Thus, in this case, the change-over switch 1 13 is set to the switched terrrunal b. 
When data 4 of the picture B1 itself is encoded, that is. when intraframe encoding is carried out on the other hand, the 
data, that is, the original data of the picture B1 , is supplied to the DOT drcuit 1 1 4 by way of the chang&<yver switch 1 1 3. 
Thus, in this case; the change^er switch 113 is set to the switched temiinal a. 

In the operation to encode the picture B1 , whfoh is a B picture, the pictures 10 and P3 have already been encoded, 

50 then focally decoded and finally stored in the frame menrxMy unit 122. Thus, the encoding can be implen^ed. 

The fourth picture B2 is encoded in the same way as the picture B1. That is to say. the description of the encoding 
of the picture B1 given so far is appGcabfo to the picture B2 provided that the symbol B1 in the description is replaced 
by the syirfool 62. 

The f fftti pfoture P6 is encoded in the same way as the picture P3. That is to say. the description of the encoding of 
55 the pfoture P3 given so far is applicable to the picture P6 provided that the symbols P3 and 10 in the description are 
replaced by the symbote P6 and P3 respectively. 

The sixth and subsequent pictures are encoded by repeating the encoding process descn'bed abov& It is thus not 
necessary to repeat the description. 
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By the way. the MPEG1 real time encode board 213 determines the picture type of a picture of each saeen to be 
encoded, that is. whether the picture to be encoded an 1. P or B picture, and detennines the macro block type of a 
macrobiockof each picture to be encoded in accordance with the amount of data wiD obtained as a result of the 
encocfing as descrt>ed above. However, the amount of data depends on the picture to be encoded and is thus not 
5 kncwn accurately unless the encoding e actually carried out 

By the way. it is basically necessary tosetthebitrateofabit stream obtai ned as a result of M P EG encoding at a 
fixed valua As a nrtethod of keeping the bit rate at a fixed value, for example, there is a technique of controlling the quan- 
tization step (the quantization scale) used in the quantizer 1 15. To put it in detail, at a large quantizatk)n step^ data ts 
quantized coarsely, resulting a small amount of generated data or generated coda At a small quantization step, on the 
10 other hand, data ts quantized finely, resulting a large amount of generated data or gerterated coda 
The quantization step is controlled in conaete terms as foOows. 

At the output stage of the MPEG1 real time encoder board 213. tiie output buffer 1 1 8 is provided. The output buffer 
118 is used for tenporarily staing encoded data to absorb changes in amount of generated data to a certain degree. 
As a result the bit rate of an output bit stream can be made constant 

IS If generation of encoded data, dnctiy speaking, variable length encoded data, at a bit rate higher than a predeter- 
mined value continues, however, ttie anxxint of data stored in the output buffer 1 1 8 will keep increasing, resulting in an 
overflow eventually. If generation of encoded data, strictty speaking, variable lengtii encoded data, at a bit rate lower 
ttian a predetenmined value continues, on the other hand, tiie amount of data stored in ttie output buffer 1 1 8 wQI keep 
decreasing, resulting in an underftow eventually. 

20 In order to solve ttie problem described above, the amount of data or code stored in ttie output buffer 118 is fed 
back to the quantization step controller 1 1 9 which controls ttie quantization step in accordance with the anx)unt of data 
or code fed back thereto so as to prevent an overflow and an underf bw from occurring in the output buffer 118. 

To put it in detail, when the amount of data or code stored in the output txiffer 118 approaches the storage capacity 
of the output buffer 118, leading to a state in which an overflow is about to occur imminentty, the quantization step con- 

2S troller 119 increases ttie quantization step in order to decrease the amount of data generated by ttie quantizer 115. 
When ttie amount of data or code stored in ttie output buffer 118 approaches 0. leading to a state in which an underf kyw 
is about to occur imminentiy. on the other hand, the quantization step controller 1 1 9 decreases ttie quantization step in 
order to inaease ttie amount of data generated by the quantizer 1 15. 

By the way, ttie amount of generated code also varies in dependence on whettier a picture is encoded by using ttie 

30 intraframe or interframe encocfing techniqua 

In general, saice intraframe encoding results in a relatively larger amoiFit of generated code, it is necessary to set 
tiie quantization step at a very large value when the amount of data ^red in the output buffer 1 18 is large. In this case, 
nevertheless, an overt kiw may occur in the output buffer 118 anyway even if ttie c^iantization step is increased to a max- 
imum value. In addition, when quantization is carried out at a large quantization stepL basically, the quality of ttie 

35 decoded pKture deteriorates and ttie quality of a picture encoded and decoded witti ttie decoded picture taken as a ref- 
erence picture also deteriorates as well. Thus, when infraframe encoding is carried out. it is necessary to preserve a 
suff k^ienUy large free area in ttie output buffer 1 1 8 in order to prevent an overflow from occurring in ttie output buffer 1 1 8 
and to prevent ttie quality of a decoded pkrture from deteriorating. 

For that reason, the quantization step controller 119 recognizes an order in whk:h intraframe or interframe encoding 

40 is to be cam'ed out in advance from a signal supplied thereto by the compression technique selecting circuit 132. The 
quantization step controller 119 controls ttie quantization step so as to preserve a suffidentty large free area in the out- 
put buffer 1 1 8 in the case of intraframe encoding. 

By the way, from ttie decoded picture quality point of view, quantization needs to be canried out at a small quanti- 
zation step for a complicated picture or a large quantization step in tiie case of a simple pk:tura In the quantization step 

45 set only on the basis of information fed back from the output buffer 118, however, such a quantization requirement is 
not taken into consideration. If the quantization step is set at a value which is improper from the picture complexity point 
of view, an excessively large or small number of bits will be alk)cated. If an inappropriate number of bits are alk)cated 
to a certain pk;ture, the numt)er of bits alkx»ted to another picture will be affected, resulting in an undesirable stata 
In order to solve ttiis problem, the quantization step controller 1 1 9 sets the quantization step at a value based on 

50 t]ynotonlythefedbackarTK>urtof data Stored in the output buffer 118 in ttie buffer fee^ 
plexity of a pk:ture subjected to encoding. 

To put it in detail, a picture evaluating circuit 130 enrpk>yed in ttie MPEG1 real time encoder tx)ard 213 reads out 
data of a picture to be encoded from the frame memory unit 1 1 0, computing an evaluation value to be used as an indi- 
cator of ttie complexity of the pk:tura The picture evaluating circuit 130 then outputs the evaluation value to a scene 

55 change detecting circuit 131, ttie conpression technique selecting circuit 132 and ttie quantization step controller 119. 
The quantization step controller 119 learns the relation among a quantization step actually used in ttie encoding of 
a picture, ttie amount of data or code obtained as a result of ttie quantization carried out at ttie quantization step and 
an evaluation value indicating ttie complexity of ttie picture from ttie picture evaluating drcuit 130 and, from a result of 
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the learning process, finds a basic quantization step xsed as a base tor setting a next quantization stepi 

To put it in detail, the quantization step controller 1 1 9 performs a regression analysts using a quantization step actu- 
ally used in the encoding of a picture, the amount of data or code oblained as a result of the quantization carried out at 
the quantizatkm step and an evaluation value incficating ttie complexity of the picture and learns ttie relation among 

5 them from a graph representing results of the analysis. Subsequentiy, a basic quantization step which is optimum for 
encodng a next picture is predicted from tiie graph with an evaluation value indicating the complexity of the next picture 
to be encoded taken as a parameter. 

Then, the quantization step controller 119 changes the basic quantization step in accordance with information fed 
backfromthe output buffer 118 and sets ttie modified value as a quantization step. 

10 A basic qiontization step can be predk:ted from ttie learning process wrtti a high degree of accuracy by taking ttie 
complexity of a picture into consideration. Thus, by finding a quantization step from such a basic quantization ^ep. ttie 
quality of a decoded picture can be tmprcved in comparison wrtti a picture obtained as a result of controlling ttie quan- 
tization step only on the basis of information fed back from ttie output buffer 1 1 8. 

It shoukJ be noted that ttie scene change detecting drcuit 131 detects whettier or not the scene changes from an 

15 evaluation value suppGed ttiereto by ttte picture evaluating circuit 1 30. A result of ttie detection is supplied to the com- 
pression techrvque selecting circuit 132. The compressk)n technique selecting drcuit 132 selects a technique of com- 
pressing a picture in accordance witti an evaluation value supplied thereto by the picture e/aluating drcuit 130 and, if 
necessary, ttie result of detection output by ttie scene change detecting circuit 1 31 . To put it in detail, ttie compression 
technique selected by the conrpression technique selecting drcuit 132, for example, determines the I, P or B picture as 

20 a picture type of a picture to be encoded, determines the number of pictures composing a GOP and determines a mac- 
roblock type, that is. whettier a macroUock is subjected to infraframe or interframe encoding. 

After selecting a oompressk>n technique, the compressk)n technique selecting drcuit 132 controls ttie change^iver 
switches 1 13 and 123 in dependence on whether a cun-ent maaobkx^k is subjected to intraframe or interframe er^xxi- 
ing. To be more specific in ttie case of a macroUock subjected to intraframe encoding, ttie change-over switch 1 1 3 is 

25 set to the switched terminal a and ttie change-over switch 123 is turned off. In the case of a maaobkKk subjected to 
interframe encoding, on ttie other hand, the changeover switch 113 is set to ttie switched terminal b and the change- 
over switch 123 is turned oa 

In addition, the compression techroque selecting drcuit 132 notifies the quantization step controller 1 19 of eittier 
the intraframe encoding technique or the interframe encoding technk^e which is selected thereby. The encoding tech- 

30 nique is used by the quantization step controller 1 19 to recognize an order in which the intraframe encoding and ttie 
interframe encoding are carried out 

If ttie compresskxi technk^ue selecting drcuit 132 has been consecutively selecting the P or B picture as a picture 
type of consecutive pctures to be encoded for a tong time, if a picture witti a low correlation between frames caused t>y 
a scene change arrives, the amount of generated data increases and the quality of a decoded pk:ture deteriorates 

35 because, a P or B pk;tiffe is bask^ally encoded by using the interframe encoding technique. 

In order to solve the problem descrOt>ed above, the scene change detecting drcuit 131 supplies a result of detectkxi 
of a scene change to ttie compressk)n technk^e selecting drcuit 132. When the compressk>n techmque selecting cir- 
cuit 1 32 is inforrned ol a scene change, the I picture is selected as a pkAjre type of a pkm^ 
in a process called a forced selection. 

40 It shouU be noted ttiat the mettiod, whereby a basic quantization step is inferred from a learning process and a 
quantization step is set from the learned t>asic quantization step as described atx>ve, is described in detail in docu- 
ments such as Japanese Patent LaM-open rOo. Hei8- 102951 submitted earfier by the patent applk»nt 

The pk:ture evaluating drcuit 130 corrputes ttie follcwing 2 parameters representing the corrplexity of a pk;ture as 
evaluation values to be used for evaluation of a ptoture subjected to encoding by referencing the frame memory unit 

45 110. 

To put it in detail, as a first parameter, an evaluation value representing ttie amount of information of a pkrture itself 
is cateulated. Witti the first parameter, ttie amount of code obtained as a result of intraframe encodng of ttie picture, 
that is, ttie amount of code obtained as a result of encocBng of ttie picture as an I pk^ure, can be predkned (or inferred). 
To put it concretely, as a typtaal first paramrter, a sum of DOT coeffkaents each obtained from DCT processing off a 

50 blodc of a pk;hjre or anottier statistical quantity can be used. As a typteal alternative, an average of pixel values for a 
block is oonputed. Then, a sum of the absolute values of differences between the average and ttie pixel values is found. 
The sum is referred to as a mean absolute difference for ttie sake of convenience. Then, a sum of mean absolute dif- 
ferences fa all bk)cks can also be used as anottier typx:al first parameter. It should be noted ttiat, in ttie case of ttie 
ottier typk:al first parameter found by calculating a sum of mean absolute differences, ttie size of ttie picture evaluating 

55 drcuit 1 30 can be made relatively small and. hence, ttie load can be reduced to a relatively small one in conparison 
witti ttie typk»l first parameter fouxJ by calculating a sum of DCT coeffkaents. 

For ttie reason described above, in ttie picture a/aluating drcuit 130. a sum off mean absolute differences for all 
blocks is found as a first parameter as folkwvs. 
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To put it in detail, now consider, for exanpte. a block S of a picture subjected to encocfing. Sy be a pix^ vatue 
of a pixel at a position on the ith column to the right from the leftmost top corner of the block S and the jth row down 
from the corner. The MAP (Mean Absolute Difference) for the block found t>yEq.(1) given below. Even though the 
equation can be applied to all luminance and chrominance blocks, the MAD \s typicaQy calculated for each luminance 
biockonly. 

8 8 

MAD=X ZISij-SaveI (1) 

where notation Save in Eq. (1) is an average of pixel values for the block S. 

Then, a sum SM AD of mean absolute differences M ADs for all blocte is computed as a first parameter by using Eq. 
(2) as follows: 

SMAD = £ MAD (2) 

where the symbol Z used in Eq. (2) indicates summation of mean absolute differences MADs for all blocks composing 
thepictura 

It should be noted that, in the pk;ture evaluating circuit 130. the mean absolute difference MAD expressed by Eq. 
(1) can also be found as a sum for a macrobkxdi instead of a block Such a mean absolute di^ 
by the compressfon technique selecting circuit 132 in detemnination of whether the maaoblock is to be encoded using 
the intraframe encoding technique or the interframe encoding technique and, in the case of the interframe encoding 
technique, selectfon of fbnward prediction encoding, backward prediction encoding or both forward and backward pre- 
diction encoding. 

As a second parameter, an evaluation value representing the amount of information on a difference between a pk;- 
ture and a refer^ice picture used in interframe erKxxiing of the picture is corrputed. With the secorvi parameter, the 
anK)unt of code obtained as a result of interframe encoding of the picture can be predicted. To put it concretely, as a 
second parameter, a sum of the at>solute values of differences between, for example, a picture and a predicted picture 
is found for each block The sum is referred to as a mean absolutedrfferenceforthesakeof convenience. A predicted 
picture is a picture obtained from motion conrpensation of a reference picture. Then, a sum of mean at)solute differ- 
ences for all bfocks is used as a second parameter. 

A rneanabsohrte difference is found when a rrxjtion vector is detected by the nxTti detector 120. Then, in the pic- 
ture evaluating circuit 130, as a second parameter, a sum of mean absolute differences is typically found by using 
resuHs of motion detection carried out t>y the motion detector 120. 

To put it in detail, now, consider, for example, a block of a reference pictura The block comprises 8X8 pixels. Let 
Rjj be a pixel value of a pixel at a position on the ith column to the right from the leftmost top comer of the block and ttie 
jth row down from the comer. Also consider an x axis in the horizontal direction and a y axis in the vertical direction for 
a picture to be encoded. In a bkxk with a leftmost top pixel thereof coinciding witti a point (x, y), let S^^, be a pixel 
value of a pixel at a position on ttie ith column to the right from the leftmost top corner of the block and thejth row down 
from the comer. 

In the motion detector 1 20. a sum d (x. y) of the absolute values of differences between the pixel values Sx4i, y+j 
and FVj expressed by Eq. (3) is found t^ increnienting tiie subscripts i and j each by 1 at 

8 8 

d(x.y)=5:ZlSx^.yH-R|jl (3) 



In the motion detector 120. coordinates (x, y) that minimize the sum d (x. y) of Eq. (3) is detected as a motion vector 
and the minimum d (x, y) is fourvJ as an atjsotute difference AD. 

Then, in the picture evaluating circuit 130. a sum SAD of absolute differences ADs each found in the motion detec- 
tor 120 for a bkxdc is computed as a second parameter by using Eq. (4) expressing summation for all blocks as follows: 

SAD = £ AD (4) 

where the symbol £ used in Eq. (4) indicates summation of absolute differences ADs for all blocks composing ttie pic- 
tura 

It should be noted tttat in the picture evaluating circuit 130, ttie absolute difference AD expressed by Eq. (3) can 
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also be found as a sum for a macrobtock instead of a block Such an absolute difference is typlcaDy used by the com- 
pression technique selecting circuit 132 in det^mination of whether the macroblock is to be encoded using the infra* 
frame encoding technique or the interframe encoding technique and, in the case of the tnterframe encoding technique, 
selection of forward prediction encocfing, backward prediction encoding or both forward and backward precfiction encod- 
ing. 

The first parameter SMAD and the second parameter SAD found by the picture evaluating circuit 1 30 are suppGed 
to the scene change detecting circuit 131, the compression technique selecting circuit 132 and the quantization step 
controller 119. 

As described above, the scene detecting circuit 131 detects the occurrence of a scene change on the basis of the 
evaluation values output by the picture evaluating circuit 130. The compression technique selecting drcurt 132 selects 
a technique of compressing a picture in accordance with the evaluation values supplied thereto by the picture evaluat- 
ing circuit 130 and, if necessary, the result of detection output by the scene change detecting circuit 131 . The quantiza- 
tion step controller 1 1 9 sets a quantization step as descra>ed abova 

ft should be noted that, in the scene change detecting circuit 131 , a ratio of the second paranrieter SAD of a picture 
to the second parameter SAD of a picture immediately succeeding the picture is found. The magnitude of the ratfo is 
used as a criterion as to whether or not the scene has changed. 

In addition, the scene change detecting drcuit 131 ateo generates index data to be described later. The index data 
is supplied to the microprocessor 201 to be stored in a generated index file also to be desaS^ed later. 

In the compression technique selecting circuit 132. for a P or B picture for example, the total mean at>solute differ- 
ence MAD and the total absolute difference AD for a macrobkx:k stqppGed thereto by the pk:ture evaluating circuit 1 30 
are compared with each other and the outcome of the comparison is used to make a dec«>n as to whether the mac- 
robfock is to be encoded by using the intrafranrte or interframe encoding technk{ue. To put it in detail, if the total mean 
absolute dfference for a nracroblock found smaller than the total absd^ 

is, if the amount of code obtained as a result of intFoframe encoding s predicted to be smaller tfian the amount of code 
otJtained as a result of interframe encoding, the intraframe encoding \s selected. If the mean absolute difference AD for 
amacrobkxkisfound snnller than the total nman absolute difference MAD for the macrobto^ 
code obtained as a result of interframe encoding is predicted to be smaller than the anrxxint of code obtained as a result 
of intraframe encoding, the tnterframe encoding is selected. 

It should be noted that in the MPEG1 real time encoder board 213 shown in Rg. 6. the controller 133 monitors the 
anfxxjnt of data stored in the output buffer 1 18 and controls the encoding process in the MPEQ1 real time encoder 
board 21 3 in accordance with the amount of data as will be described later. 

The following ts a description of Sfipclip^ a set of 5 application programs staed in the hard cSsc 212 for video crea- 
tive work. 

When the pcwer si^y of the main unit 31 is turned on by the user by operating the power supply button 34. the 
operating system stored in the hard disc 212, namely. Windows 95 cited eariier, is activated. When a start button of a 
task bar thereof is clicked, a start menu is displayed. 

In this enrtodiment, as an item of the start menu, typically "VAIO** is displayed. In the "VAIO" item, predetermined 
application programs including Stipdip are catafoged. 

As descrS>ed above, the Slipdip software comprises 5 application programs called the slip recorder, the dip ecfitor, 
the dip viewer, the vkJeo CD creator and the video CD copy tool which are all cataloged in Slipdip of "VAIO^. Thus, 
when the "Slipdip" item dicked by operating the mouse 22. 5 items representing the 5 application programs, namely^ 
" sTip recorder, "dip editor, "d^ viewer", Video CD creator and VkJeo CD copy tool" are displayed on the saeea 

The user then dicks one of the rtems in accordance with the purpose of the job to invoke an application program 
corresponding to the dicked item. 

When a photographic material to be used in aeationof avideo CD is taken by means of the video cam^ 21 4 and 
recorded on a recording medium, the slip recorder is activated if the photographfo material is recorded in a sirrple way 
as is the case with recording of a television broadcast program t^ using a recording apparatus such as the VTR 216. 
In tills case, a slip recorder main window 301 like one shown in Fig, 7 is displayed. 

As shown in the figure, the slf> recorder main windcw 301 comprfees a variety of incBcator and display f iekls and 
buttons. 

To put it in detafl, on a recording indicator fieM 302. recording status is dsplayed. To put it concretely, for status of 
waiting for the start off a recording operatfon after a recording reservation, typically the word TIMER" s displayed on 
the recording indicator field 302. For status of canning out a reserved recording operation, typically the words TIMER 
REC" are displayed on the recording indicator fiekJ 302. If a recording operation is started by operating a recording but- 
ton 309, typically the word "REC" is displayed on the recordng incficator f iekf 302. If a recording operation is temporanTy 
halted by operating a pause button 31 0 or hatted by operating a stop button 308. typically the 
"STOP" respectively is displayed on the recording indicator f iekJ 302. 

A scene change indicator field 303, which has a shape resembling a flag, is displayed only when the occurrence of 
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a scene change on a picture to'ng recorded is detected In other words, nomiaily, the scene change incficator field 303 
is not displayed. If a scene change is detected, the scene change indicator field 303 is delayed for a fixed period of 
timetonotifytheuserof ttieoccuH'enceof the scene changa 

On a present tinie display field 304, the present time is displayed on a so^^Iled 24-hour hasiSw The present time 
5 display field 304 displ^ typicaDy the time controOed by "date and time" of a control panel of Windows 95 as it is. 

On a recording time d^ay field 305, time information such as a time lapse since the start of a recording operation, 
a remaining time to the end of the recording op^ation or a remaining period of time tfll the end of a tape to be described 
lat^ ^ dsplayed. By operating a time button 311 , that s, a recording time d^lay change button, the can select 
which time infomnation to be displayed on the recording time display field 304. It should be noted that, if a recording 
10 operation ts not being carried out, typically "00 : 00 : 00" e displayed on the recording time dsplay field 305. 

On a timer standby indicator field 308, the status of a reservation recording operation is delayed. When a record- 
ing reservation is made, putting the status in a state of waiting for the ^art of the reservation recording operation, for 
exanple, the start time of the reservation recording operation is displayed on the timer standby incficator field 306 to 
incficate the status of waiting for the start of the reservation recording operation. To put it concretely, vvhen the present 
IS status is status of waiting for a ressn^tion recording operation which will start at 14:55, for example, the word "OhT is 
dteptayed to indicate the status of waiting for a reservation recording operation and the time "14 : 55" is displayed to 
incficate that the reservation recording operation will start at 1 4 : 55 as shown in Rg. 7. Static of presently carrying out 
a reservation recording operation also displayed along with an end time of the resen/ation reoorcfing operatioa To put 
it concretely, for exairple, status of presently carrying out a reservation recording operation which will end at 2 1 : 43 is 
20 indicated by the word "OFP and the time "21 : 43" cfisplayed on the timer standby indicator field 306. 

It should be noted ttiat. in the case of a recording operation other than a reservation recording operation wtuch is 
referred to hereafter sirrpty as ordinary recording for the sake of convenience, a message identical with that for indicat- 
ing that the orcfinary recording is urider way is displayed e^en if the end time has been set 

Status of carrying out an ordinary recording operatfon with no end time set is dis- 
25 played on the timer standby irxJicator field 306. 

For operations other than the reservation and orcGnary recording operations, nothing is displayed on the timer 
standby indicator field 306. 

On an endless recortfing display field 307A, a message indicating a type of a tape to be descrO^ed later is displayed. 
In the case of an "endless" tape type, the character "E" is displayed on the endless recording display field 307A as 
30 shown in Fig. 7. In the case of a "normal" tape type, on the other hand, nothing is displayed on the endless recording 
display field 307A. 

On an input source cfisplay field 307B, a message indicating a selected recording object is displayed. To be more 
specific, if an input from the AV temfiinal unit 84 on the rear surface of the main unit 31 or an input from the AV terminal 
unit 43 on the front surface of the main unit 31 is selected, the words "Video 1 " or "Video 2" respectively are cfisplayed 
35 on the input source display field 3078. If the output of the TV tuner 2 1 3A is selected, a message TV-O" is displayed on 
the input source display field 307B. It should be noted that, on the O mark portion of the message, the nunr4>er of a 
channel selected by the TV tuner 2 1 3A is displayed. On the window shown in Rg. 7, a message TV-I " is displayed on 
the input source display f ietel 307B to indicate that a program broadcasted through Channel 1 is selected as a recording 
object 

40 The stop button 308, the recording button 309 or the pause button 31 0 is operated to stop a recording operation, 

to start a recording operatfon or to temporarily stop a recording operation respectively. It shoukJ be noted that when a 

recording operatfon has been halted tenrporailly t>y operating (or 

can be resumed by operating the pause button 31 0 once mora 

As desafoed above, the recorcfing time display change button 31 1 is operated to change a message displayed on 
45 the recording time dsplay field 305. To be more specific each time the recording time display change button 31 1 is 

operated, the message displayed on the recording time display field 305 is switched alternately from a time lapse to a 

remaining period of time and vice versa. 

An input switch button (input button) 312 isoperated to change an input selected as a recording object To be more 

specific each time the input switch button 31 2 is operated, one of an input from the AV terminal unit 84 on the rear sur- 
50 face Of the nriain unit 31, an input from the AVternftinal unit 43 on the front surfaced and the output of 

the TV tuner 21 3A is selected on the so-called rotation basis. When the input switch button 31 2 is operated, a message 

displayed on the input source cf splay field 307B is also change accorcfingly. 

Wrth the output of the TV tuner 21 3A selected as an input to a recording operation, for example, one of two up and 

down buttons 313 is operated to change the number of a channel selected t^y the TV toner 213A from a channel cur- 
55 rentty selected to respectively a succeecSng or preceding channel shown on channel buttons 31 4. With the output of the 

TV toner 213A selected as an input to a recording operation, one of the channel buttons 314 is operated to choose a 

channel to be selected by the TV tinier 21 3A. It shouM be noted that, the numbers of the channels displayed by the 

channel buttons 314 can be set at any values in the range 1 to 62 by using a "channel setting" item of an optional menu 
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on the slip recorder main window 301. 

With the slQ) recorder main window 301 having the atX3ve configuration displayed, assume that the input switch txit- 

ton 31 2 is operated to select an input to a recording operation and, if the output of the TV tuner 21 3A is selected as the 

input, the up or down button 313 or the one of the channel Ixittons 314 s opmted to select a channel of the input. 
5 Then, the recording button 309 is operated to start the operation to record pictures along with their acconpanying 

sound of the selected input If the recording operation is canied out by the slip recorder, it ^necessary to set a tape to 

be used in the recorcfing operation. 

To put it in detail, when a recording operation is requested by operating the recording button 309 and the others as 

described above, p'ctures of the recording object are encoded t>y the MPEG1 real time encoder board 21 3 and encoded 
10 data obtained as a result of the encoding operation is stored in the hard disc 212. If the encoded data is sirrply stored 

in the hard dasc 212. however, a free area in ttie hard disc may be insufficient making it impossible to carry out the 

reconfing operation. 

By the way, if the reoorcfing operation is carried outtorecorddataonavideotapeby means of an apparatus such 
as a VTR, for example, the data can be recorded in a space between the beginning and the end of the video tape with- 
15 out any restriction. This is because the video tape is considered to have a recording capacH^ 

With the "Sfipdip" fadlily, a recording area larger than a recorcfing capacity required for carrying out a normal 
recorcfing operation is allocated in the hard disc 21 2 and data including encoded code is then recorded in the recording 
area. The recording capacity is a minimum reconfing size required for carrying out a recording operation without atxMl- 
ing the operation in the course of recording due a free area in the hard disc 212 running out. For the sake of conven- 
20 ience, the recorcfing capacity and the recording area required for reoorcfing are refenred to hereafter as a required 
capacity and a required area respectively. 

To put it in detail, in an operation to record pictures carried out in this embodiment, a large f Oe required for recording 
an MPEG system stream obtained as a result of MPEG encoding performed by the MPEG1 real time encoder board 
21 3 and a large f Oe required for recording infomnatfon such as indexes to be described later are generated. The former 
26 and the latter files are referred to hereafter as an MPEG f Be and an index f Oe respectively for the sake of convenience. 
Since the files are stored in the hard disc 212, it is necessary to allocate an area required for recording data including 
encoded code, that is, the MPEG system stream, in the hard disc 212 in advance. 

After all. the MPEG and index files with a total size equal to or greater tfmn the required capacity are allocated in a 
free area in the hard disc 212. 

30 The contents of the MPEG and index files right after allocation in the hard disc 21 2 are infomation with no meaning 
in particular. The allocation of the f Oes corresponds to preparation of a new video tape in a recording operatfon by 
means of a VTR. For this reason, the files are refen^ed to as a tape in slip recorder. 

A tape can be set by using typically a tape setting dialog box 321 like one shown in Rg. 8. 
The tape setting dialog box 321 is displayed by clicking a message "Standard tape setting", an item of an "Edit" 
35 rnenu displayed on the upper part Gf the Slip recorder rnain window 301 shown in Fig^ 

The user enters a narne to be appended to a tape into a narnefieU 322 on the tape setting dialog box 321. Inttie 
embodiment shown in Fig. 8. the name Tape" is entered. A name entered in the name f ieW 322 is a file name common 
to the MPEG and index files constituting a tape being set It should be noted that, in order to distinguish ttie MPEG and 
index fOes from each other, typk:al file name extensfons "MPG" and "SCX" are given to the MPEG and index files 
40 respectively. Thus, with the nan^ "Tape" entered in ttie name f ieU 322 as a file name, the hill f Oe names of the MPEG 
and index files ccmstituting the tape are as a rule Tape.MPG" and "Tape-SCX" respectively. 

A write protect box 323 is checked to put write protectfon on the tapa A type fieU 324 is used for setting a type of 
the tape descrit}ed t>elow. 

In the case of tiie slip recorder. 2 types of a tape, nannely. "norrnal" and "endless", are provM 
45 tape and an endless tape which are shown in 9A and 9B respectively. 

When a nonnal tape is specified. MPEG and index files are created to form a tape witii a minimum required record- 
ing capacity at least equal to a recording time set in a recording time field 325 described later. If a recording time of 1 
hour is set in ttie recording time field 325, for exarrple, a tape witii a recording capacity of 1 hour shown in Rg. 9A is 
created. 

50 When an endess tape is specified, on ttie other hand, tapes each witii a fixed recording capacity of typically 15 
minutes are created to fonn ttie endless tape like one shown in Rg. 98. Such tapes are each referred to hereafter as a 
fixed tape for tiie sake of convenienca As many fixed t^>es as rec^ired to form an endless tape with a recording capac- 
ity at least equal to a value corresponding to a recorcfing time set in the recording time field 325 are created. That is to 
say. the nurnber of fixed tapes each having a recording capacity d 15 minutes is obtained by recording time 

55 set in ttie recording time fiekl 325 by 1 5 minutes and then adding 1 to a quotient obtained as a result of ttie divtefon. In 
tttis embocBment ttie recorcfing time of each fixed tape is set at a typical value of 15 minutes as will be described later. 
To put it concretely, assume ttiat a recording time of 1 hour is set in ttie recording time f ieM 325 for example. In tNs case, 
5 fixed tapes are aealed to from an endless tape as shown in Rg. 9B. Since ttie number 5 is obtained by dividing 1 hour 
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by 1 5 minutes to give a quotiem of 4 and adding 1 to the quo^ 

can l>e used for recording data tor a period of up to 1 hour and 15 minutes. 

As descrS>ed above, a normal tape oonprisesi MPEG fOe and 1 index fila It is obvious from the embodiment given 

above, however, that an endless tape may connpr^ a plurality of fixed tapes which eac^ comprise an MPEG file and 
5 an index ffle. In order to distinguish MPEG ffles and index files of an endless tape from each other, the name of each 

MPEG file or each index file includes the symbol "r fbilowed by the sequence number of the file. 

Ck)nsider the endless tape shmn in Rg. 9B as an exampla The endless tape comprises 5 MPEG files and 5 index 

ffles. Their file names are Tape#1.MPQ, Tape#1.SCX. Tape#2.MPG. Tape#2.SCX. Tape#3.MPG. Tape#3.SCX. 

Tape#4.MPG. Tape#4.SCX. Tape#5.MPG and Tape#5.SCX. 
10 An operation to record data on a nornrtal tape is begun at the start of the tape and. at a poff^ 

tape is reached, the operation is ternninated. It should be noted that, if an instniction to halt the operation is issued 

before the end of the tape is reached, the operation ts terminated at a point of tinie the instruction is issued. In this case. 

portions of the MPEG and index files that have not been used in the recording operation are freed. That is to say. they 

are released as free areas. 

IS On the other hand, an operation to record data on an endless tape is begun at the start of the first fixed tape if the 
endless tape comprises a plurality of fixed tapes. As the end of the first fixed tape is reached, the operation to record 
data on the first fixed tape is terminated and an operation to record data on the second fixed tape is begua Thereafter, 
operations to record data on the third, fourth. — .last fixed tapes are carried out sequentially one tape after another. As 
the end of the last fixed tape is reached, an operation to record, strictly speaking, to overwrite, data on the first fixed 

20 tape is carried out again. 

That is to say. in the embocfiment shown in Rg. 9B, when the operation to record data on all the first to fifth fixed 
tapes is finished, an operation to record, strictly speaking, to overwrite, data on the fff^ 

ing operation is earned out on a rotation basis tin an instruction to end the operatkXY is issued typically when the stop 

button 308 is operated. Such a recording operatkm on a rotation basis is continued, so to speak, endlessly. 
25 Then, as an instruction to end the recording operatk>n is issued, the operation is terminated right away at that point 

of time. In this case, in "Slipdip". a retroactive area with a length specified in the recording time field 325 in the endless 

tape starting from the point of time the recording operation is terminated is made a playt>ack range 

To put it concretely, consider the endless tape shown in Rg. 9B for exampla Assume that an instruction to end the 

recording operation is issued at a point of time 10-mtnute recording on the fifth fixed tape is ended. A hatched area of 
30 1 hour in length shown in the figure which starts at a 10-minute position on the first fixed tape and ends at a 10-minute 

position on the fifth fixed tape is made a playt>ack range. 

It shouM t>e rxjted tiiat, in this case, an area on the first fixed tape from the start thereof to the 1 0-minute position 

arxJ an area on the fiftti fixed tape from tfie 10-minute position to the end thereof are not playt}ack ranges. Thus, when 

viewed from the standpoint of the utilization effkaency of the hard disc 212, these areas shouM be botii freed. In tfiis 
35 casa however, only the area on the fifth fixed tape from the 10-nmnute position to the en^ 

on the first fixed tape from the start thereof to the 1 0-minute position is not for the fblkiwing reason. 

At the head of an MPEG file of a fixed tapa a system header and information requred in an operation to decode 

data experiencing MPEG encoding are recorded. If such an area is discarded, the decoding operatkxi will be difficult to 

cany out 

40 Thua data recorded in the area on the first fixed tape from the start thereof to the 10-minute 
back by directly accessing the MPEG file of the first fixed tape. 

It shoukJ be noted that an endless tape may comprise only 1 fixed tape as is the case with a normal tape instead 
of a plirality d fixed tapes described above. When such an endless tape is cr^ed, the endless tape is specified as a 
type of the tapa In this casa there can be considered a recording technk^e whereby a recording operation is started 

45 at the beginning of the fixed tape and. as the end thereof is reached, the operation to record, strictly speaking, to over- 
writa data is repeated from the same beginning of the fixed tape. As deserved abova however, information including 
a system header is recorded at the head of an MPEG file of a fixed tape. Thua if such infomnation is ovenwritten, ttie 
decocfing operation win be drff kxilt to carry out It is therefor desirable to aeate an endless tape from a plurality of fixed 
tapes. 

50 Refer back to Rg. 8. The user enters a recording tima that ia a period of time required for recording, to the record- 
ing time fiekj 325. A recording time up to 12 hours with a resolution of 15 minutes can be typically entered to this fiekJ. 
It should be noted that a recorcfing time is entered in terms of hours and minutes. 

An automatic index check box 326 is checked to request that an index serving as a mark for representing a position 
of a scene change of a picture be autonntically appended in a recording operation. If the automatic index check box 
55 326 is not checked, information such as a scene change pointer and a scene change parameter to be described later 
is not recorded in an index file. 

In a vkieo recording mode f ieU 327. a video recording mode indicating bit rate information is set 4 vkieo recording 
modes are provkJed to represent 4 bit rates, namely, enumerated in a decreasing order. "High", Tstormal". "Long" and 
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•Network-. 

Rg. 10 is a table showing the size of a frame, a system bftr^^ 
audk>recor(fingmodethatcanbes6tandavideorecorcfingtimeofa1-GBtapefo^ modes. 
The size of a frame Is the nunrt>er of pixels in the horizontal cfirection X the number of pixels in the vertical direction. The 
5 systembitrateisthebftrmeof a system Stream Obtained as a result Of MPEG encoding of a pl^^ 

is the bit rate of code obtained as a result of MPEG encoding. The frame rate is the number of frames per second. The 
audio bit rate the bit rate of a system stream obtained as a result of MPEG encoding of sound. The video recording 
time of a 1 -GB tape s a period of time diHing which data can be recorded on a tape with a storage capacity of 1 GB. 
As shown in the table, even ttrough the video recording time of a 1 -GB tape for the "KBgh" video recording mode is 
10 shortest, a decoded picture with the highest picture quality can be obtained, tn the 'fMormar video recording mode, a 
system stream conforming to video CD (VCD) specifications can be obtained as descrbed above The "Lx>ng'' video 
recorcOng mode is suitable for an appltcation with a relatively long recording time but requiring a not so high picture qual- 
ity of decoded pictures. The bit rates for the "NetworiT video recorcSng mode are set at values allowing real time trans- 
mission through an ISDN (Integrated Service Digital Networi^. Thus, the TMetworic" video recording mode is suitable for 
15 an application involving such transmission. 

It should be noted that, in the "Long" video recording mode, the number of pixels composing a frame is about 1/4 
of those of the "High" and "NormaT video recording modes. The nmb& of pixels for the "Network" video receding 
mode is e^en smaller. The frame rate, that is, the number of frames per second, is 30 for the "High" and "NontiaT and 
"Long" video recording modes and 10, 1/3 of 30, for the "Network* video recorcfing moda 
20 Refer back to Fig. 8. In an audio recording mode field 328, an audio recording mode is set. 3 aucf o recording 
modes, namely, 2 channels (duaO. stereo aiKl morK)phonic (single) are provided. 

It should be noted that in the "High" and "Long" video recording modes, either the 2-channel audio recorcfing mode 
or the stereo audio recording mode can t>e selected as shown in the table of Fig. 10. In the "NamaT video recording, 
however, the audio recording mode is f ixed at the 2-channel mode and, in the "NetworiT video recorcfing, however, the 
25 audio recording mode is fixed at the monophonic moda 

An auto check box 329 of a dip aeation foMer is checked to request that a folder set in advance to be used as a 
fokfer for creating a d^. A dip is a pair of MPEG and index ffles. In the slip recorder, such a pair is referred to as a tapa 
In the dip editor and the dip viewer, however, the pair is called a dip. Thus, a normal tape is considered to be the same 
as a dip. Corrposed of a plurality of pairs of MPEG and index f fles. however, an endless tape con-esponds to a plurality 
30 of dips. 

A reference button 330 of the dip creation folder is operated to spedfy a folder for aeating a dq?. 
On an information field 331, infbrmatfon inducfing a size, a frame rate, a video bit rate and an aucfio bit rate of a 
decoded picture obtained as a resiit of encoding in a video recording mode set in the video recording node field 327 is 
displayed. That is to say. the infonnatfon such as size shown in the table of Rg. 10 for the specified video recording 

35 mode is dteplayed on the information field 331 . 

Also displayed on the information field 331 is a size or a recorcfing capacity of a tape allocated on the hard disc 21 2, 
that is. a size of a disc area allocated to tfie tape for recording an MPEG system stream obtained as a result of an 
encocfing operation in a video recording nvxle set in the video recording mode field 327 for a recording time set in the 
recorcfing time field 325. 

40 The size of the tape is typically calculated as follows. 

The system txt rate for a video recording vnodB set in the video recording tnode f ieU 327 is multiplied by a recording 
time set in the recording time field 325 to find the size of the MPEGfOeof the tapa The size of the index file of the tape 
is estimated to be typically 0.1% of the size of the MPEG fila Rnally. the size of the tape is found by adding the size of 
the index file to the size of the MPEG fila 

45 n shoiJd be noted that basically, system bit rates for the video recording modes have the values shown in the table 
of Fig. 10. For the "Normal" video recorcfing nrwda however, a value smaller than a system bit rate of 1.411,200 bps 
shown in the table of Fig. 1 0 is used for a reason descrfoed as follows. The system bit rate shown in the table of Rg. 1 0 
for the "Normal" vkieo recording mode a value applicable to an operation to record an MPEG system stream onto a 
video CD. This value represents the bit rate of a bit stream obtained by adcfing information such as a sink and a header 

50 preserved in vkJeo CD specifications to a pack of the MPEG system stream. That is to say, the system bit rate shown 
in the table of Fig. 10 is a bit rate conforming to the vkteo CD spedfk^ations. In an operation to record an MPEG system 
stream onto the hard cTisc 212. such information induding a sink and a header is not rec|uired. In addition, when viewed 
from the standpoint of the utilization effidency of the hard disc 212, uinecessary data should not be recorded in the 
hard (fisc 212. 

55 Thus, for the "htormal" video recording mode, the size of a tape is cateulated by assuming that the bit rate of the 
MPEG system stream composing of only a pack is 1.394,400 bpa 

To put it concretely, consider the embodiment shown in Fig. 8 in which the "NormaT vkJeo recording mode is 
selected and a recording time of 1 hour is set If a norntal tape is specified as a tape type, the size of the tape will be 
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computed by muttplying the system bit rate 1 ,394.400 bps by the reconfing time 1 hour and adtfing 0. 1% of the product 
obtairYed as a result of the multiplication to the product In the errtxxfiment shown in Rg. 8, however, an endless tape 
isspectfiedasatapetype. According to what has been described before, the recording capacity of the endless tape is 
longer than the recording time 1 hoi^ specified in the recording time field 325 by a diff^ence of 1 5 minutes. An endless 
5 tape size of 748.76 MB is found by multplying the system bit rate 1 ,394,400 bps by the recording tiiDe (1 hour + 15 ntin- 
utes) and adcfing 0. 1% of the product obtained as a result of the multp&cation to the product The size 748.76 MB of 
the endless tape scfisplayed on the information field 331 of the tape setting dialog box 321 shown in Rg. 8. 

An OK button 332 is operated to confirm items set anew in the tape setting dialog box 321 ^ 
321. A cancel button 333 is operated to keep items set previously in the tape setting dialog box 321 and dose the dialog 
10 box 321 . A help button 334 is operated to dteplay explanations for helping the user understand the tape setting dialog 
box 321. 

Next the recording process carried out tyy means of the slip recorder is explained t>y referring to flowcharts shown 
in R^ 11 and 12. 

In order to carry out a recording operation, first of all. the user opens the tape setting dialog box 321 shown in Rg. 
75 8 for setting a tape as descrft>ed earlier. 

Then, assume ttiat a television broadcast program is recorded as an example. In this case, the input switch button 
312 of the sflp recorder rnain window 301 shown in Rg. 7 ©operated to select the output of the TV tuner 213A shown 
in Rg. 5 as an input to the recording process. Then, one of the up and down buttons 313 or one of the channel buttons 
31 4 is operated to select ttie channel of the program to be recorded. 
20 When reconfing or dubbing pictures and the accorrpanying sound which have been recorded by means of ttie 
video camera 214. video and audio output terminals of ttie video camera 214 not shown in the figures are connected to 
ttie AV terminal unit 84 on ttie rear surface of ttie main unit 31 or ttie AV t^mnal unit 43 on ttie front surfece ttiereof. 
Then, ttie input 8Amch button 31 2 is operated to select the AVtenminal unit 84 or 43 as an input to ttie recording process. 
When ttie user operates the recording button 309 of ttie slq^ recorder rnain window 301 after ttie setting operations 
25 desabed above, ttie microprocessor 201 carries out a recording process in accordance witti ttie flowchart shown in 
Rg. 11 or 12. 

The flowchart shown in Rg. 11 represents a recording process wfierein a rK)rmal tape has t>een set as a tape used 
in ttie recording proces& As shown in ttie figure, ttie flowchart begins witii a step SI to form a judgment as to whettier 
a tape can be created or not 

30 An area in the hard disc 212 required for a recording process is not allocated to a specified tape t}y merely setting 
the tape through ttie tape setting dialog box 321 . That is to s^. it is not until the recording button 309 is operated ttiat 
a tape is allocated in the hard disc 21 2. This is because, when viewed from the standpoint of utilization efficiency of the 
hard disc 212. aDocationof a tape prior to the start of a recording process is not desirable. 

In the formation of the judgment at ttie step SI . the size of the specified tape is computed in the way descrit>6d ear- 

35 lier. The judgment is then based on confirmation as to whether an area with the computed size can be allocated in ttie 
hard disc 212. 

If ttie outcome of ttie judgment formed at ttie step SI indicates ttiat ttie specified tape can not be made, ttiat is. if 
the outcorrie indicates that a free area witti a size at least equal to ttie corrputedtap^ in ttie hard disc 212 can not 
be allocated to ttie specified tape, typically a message indicating ttiis problem is displayed and ttie recording process is 

40 terminated. In this case, no recording is carried out 

If ttie outcome d ttie judgment formed at ttie step SI indicates ttiat ttie specif ied tape can be made, ttiat is. if ttie 
outcorne indicates ttiat an MPEG fHe and an index f3e of ttie specified tape can be stored in ttie h^ 212, on ttie 
other hand, ttie flew of ttie process goes on to a step S2 at which ttie MPEG and index files are allocated in ttie hard 
disc 212. It should be noted ttiat. at ttie present stage, ttie MPEG and index f Oes contain no meaningfd information in 

45 particular as descrS}ed befora That is to say. a free area in ttie hard disc 21 2 is merely allocated to ttie MPEG and index 
files. 

Then, ttie flew of ttie process proceecte to a step S3 at which ttie MPEG file of ttie tape is opened. The flow of ttie 
process ttiOT continues to a step S4 at which ttie MPEG1 realtimeencoder board 213 is controfled to carry out MPEG 
processing ttierein on an input selected by operating ttie input switch button 312. 

50 Subsequentiy, ttie flow of ttie process goes on to a Step S5 at which an MPEG system Stream obtained^ 

of the MPEG encoding Is transfened to the hard disc 212 to be written into the MPEG file allocated therein at the step 
S2. Then, ttie flow of ttie process proceeds to a step S6 to form a judgment as to whettier or not ttie MPEG system 
stream being written has reached ttie end of ttie MPEGfileand whettier or not ttie stop button 308 has been operated 
to request that ttie recording process be tenninated. If ttie outcome of the judgment indicates ttiat ttie MPEG system 

55 stteam being written has not reached ttie ^ of ttie MPEG fie and ttie stop button 308 has not been o(^^ 
of the process returns to ttie step S4 to continue the encoding and ttie recording of object pictures. 

tt ttie outcome of ttie judgment indicates ttiat ttie MPEG system stream being written has reached the end of ttie 
MPEG foe or ttie stop buttcMi 308 has been operated, on the ottier hand, ttie flow of ttie process goes on to a step S7 
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, at which the MPEG fie is closed to end the recording process. 

The fbllGwIng Is a descriition of a recording process wherein an endless tape has been set as a tape used cn the 
recorcfing process carried out in accordance with the flowchart of Rg. 12. 

As shown in the figure, the flowchart begins with a step S11 to be followed b/ a step S12 which are basically the 
same as the steps S1 and S2 of the flowchart shown in Fig. 1 1 respectively, ft should be noted, however, that at the step 
SI 2, an endless tape conprising a pluralrty of fixed tapes like the one shown in Rg. 9B descrbed before is created. 

After completing the processing of the step S12, the flow of the process goes on to a step S13 at which the MPEG 
file of a head fixed tape, that s, the first fixed tape, of the endless tape is opened. The flow of the process then proceeds 
to a step S14 at which the MPEG1 real time encoder board 213 is controOed to cany out MPEG processing therein on 
an input selected by operating the input switch button 312. 

Subsequentiy, the flow of the process goes on to a step 31 5 at which an MPEG system stream obtained asa result 
of the MPEG encoding is transferred to ttie hand dsc 21 2 to be written into the MPEG f fla Then, the flow of the process 
proceeds to a step S16 to form a judgment as to whether or not a request has been made to terminate the recording 
process typicaOy by operating the stop button 308. If the outcome of the judgment formed at the step SI 6 indicates that 
a request has not been made to ternrvnate the recording process, the flow of the process continues to a step SI 7 to 
fbmi a judgment as to whether or not the MPEG system stream being written has reached the end of the MPEG file of 
the fixed tape. If the outcome of the judgment formed at the step S17 indicates that the MPEG system stream being 
written has not reached the end of the MPEG file of the fixed tape, the flow of the process returns to the step SI 4 to 
continue the erKXxJing and the recording of object pictures. 

If the outcome of the judgment formed at the step S17 indicates that the MPEG system stream being written has 
reached tiieendof the MPEG file of the fixed tape, on the other hand, the flow of the process goes on to a step SI 8 at 
which this MPEG file is closed. Then, the flow of the process proceeds to a step SI 9 at which the MPEG file of the next 
fixed tape Is opened. The flow then returns to the step S14. As a result the MPEG system stream is recorded on the 
MPEG file of the next fixed tape. 

As the MPEG system stream being written has reached the end off the MPEG file of the last fixed tape, at the step 
SI 9, the MPEG file of tiie first fixed tape is opened again. The MPEG system stream is then recorded on the first fixed 
tape, ovenvriting data recorded thereon previously. As a result, the MPEG system stream is recorded endlessly so to 
speak tin the outcome of the judgment formed at the step SI 6 incficates that a request has been made to terminate the 
recorcfing process. 

When the stop button 308 is operated, for exanrple, the outcome of the judgment formed at the step SI 6 indicates 
ttiat a request has been made to terminate the recording process. In this case, the flow of the process goes on toa step 
S20 at whk^ the opened MPEG file is dosed to terminate the recording process. 

In the recording process, an MPEG system stream is recorded on the MPEG f Oe of a tape as described above and. 
at the same time, predetermined data is stored in the index file of the same tape. 

Rg. 13 shows a flowchart representing an index recording process to record data in an index file. 

As shown in the figure, the flowchart begins with a step S30 at which an index f Qe is opened arvi a header is 
recorded in the index file The header includes, among other information, a start time arxl a recording mode set on ttie 
tape setting dialog box 321 shown in Rg. 8. The start time is a time, strictty speaking, the present time, at whfoh record- 
ing is started. The flow of the process then goes on to a step S31 at which the microprocessor 201 forms a judgment 
as to whether or not index data has been transmitted by the scene change detecting circuit 1 31 employed in the MPEG1 
real time encoder board 213 shown in Rg. 6. If index data has not been received, the flow of the processing goes on to 
a step S39, skipping steps S32 to S38. 

If the outcome of the judgment formed at the step S31 indicates that index data has been transmitted by the scene 
change detecting drcurl 131 shown in Rg. 6, on the other hand, the miaoprocessor 201 receives the index data. The 
f fow of the process then proceeds to the step S32. 

Rg. 1 4 is a diagram showing a typical format of index data transmitted by the scene change detecting circuit 1 31 . 

As shown in the figure, the index data comprises a 44)rt area for storing a variety of flags followed by a 28-bit area 
for storing the second parameter SAD computed by using Eq. (4) as descnl>ed eariier to give a total lerigth of 32 bits. 
The 4-bit area typically includes a picture type flag and a scene change flag. The picture type flag incficates a picture 
type of a frame subjected to computation of the second parameter SAD and the scene change flag indicates whether 
or not the scene change detecting drcuit 131 has detected a scene change. 

Refer back to Rg. 13. At the step S32, the miaoprocessor 201 examines the index data received from the scene 
change detecting circuit 131 in order to form a judgment as to whether the index data Indicates an I or P pk^jre It 
should be noted that the judgment s formed typically by referring to the picture type flag included in the index data. 

If the outcome of the judgment formed at the step S32 shows that the index data indicates that the picture type is 
neither an I picture nor a P picture, that is. rf the picture type is the B picture, the flow of the processing goes on to the 
step S39. skipping the steps S33 to S38. If the outcome of the judgment fonned at the step S32 shows that the index 
data indicates an I picture or a P picture, on the other hand, the flow of the process proceeds to the step S33 at which 
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the miaoprocessor 201 forms a judgment as to whether or not a scene change in the I or P picture has been detected. 

It should be noted that the judgment is formed typically by referring to the scene change flag included in the index data. 
If the outcome of the judgment formed at the step S33 indicates that a scene change has not been detected, the 

flew of the processing goes on to the step S3d. skipping the steps S34 to S37. If the outcome of the judgment formed 
5 at the step S33 indicates that a scene change has been detected, on the other hand, the flow of the processing goes 

on to the step S34 at which the miaoprocessor 201 computes a scene change parameter. To be more specific, the 

microprocessor 201 (fivides an SAD included tn the index data received this time by a previous SAD saved at the step 

S38 to be descn1>ed later, using a result of the cGviston as a scene change parameter. 

The scene change parameter irxficates the magnitude of a scene change, that is. a degree to which a screen 
10 changes. The larger the magnitude, the greater the value of the scene change parameter. It should be noted that the 

scene change parameter is not limited to the quantity obtained t>y the division desaa>ed abova The scene change 

parameter can be any quantity of physics as long as the quantity indicates the magnitude or the degree of a scene 

change. 

After the scene change param^er is conputed. the flow of the process continues to the step S35 at which the 
IS microprocessor 201 forms a judgment as to whether or not the scene change parameter is greater than a predeter- 
mined threshold value e of typically 3. If the outcome of the judgment fomned at the step 835 incficates that the scene 
change parameter ts not greater than the predetermined threshold value c the flow of the processing goes on to the 
step S38. skipping the steps S36 and S37. 

If the outcome of the judgmerrt formed at the step 835 incficates that the scene change parameter is greater than 
20 the predetermined threshold value e, on the other hand, the flow of the processing goes on to the step 836 at which a 
scene change pointer is found and associated with the scene change parameter. A scene change pointer is information 
on a location in the MPEG file for storing encoded data of a frame wfK>se scene change is represented t>y the scene 
change paranieter. Then, an identfftcation flag to be descri>ed later is added to the sc^ 

change parameter. Rnally. the identification flag, the scene change pointer and the scene change parameter are stored 
2s in the index file. 

It should be noted that a scene change pointer is typically an offset of a specific location expressed in terms of 
bytes from the head of an MPEG file for storing encoded data at the specific location. 

For the sake of convenience, information comprising a scene change pointer, a scene change parameter and an 
kfentfficatfon flag added thereto is referred to as an index. An index plays the role of a mark indicating the position of a 
30 scene changa 

It shouU be noted that, an index appended by the microprocessor 201 and stored in the index f De in a recording 
operation Is referred to as an automatk; index. An index can also be appended by a predetermined operation carried 
out by the user. An index appended by an operation carried out by the user is referred to as a manual index. The iden- 
tif catbn flag is typk^lly 1 -bit flag for distinguishing an automatic index from a manual index. 

35 After the processing of the Step 836. the fk]w Of the process goes on to the Step 837 at whic^ 

cator 303 is displayed on the slip recorder main window 301 shown in Fig. 7 for a predetermined period of time in order 
to Inform the user that a scene change has oocunred. The flow of the process then proceeds to the step 838 at which 
the SAD included in the index data received this time is stored in the main memory unit 202 to replace the SAD stored 
pramxisly. Then, the fkw of the process continues to the step 839 to form a 

40 to record the MPEG system stream into the MPEG file has been finished. If the operation to record the MPEG system 
stream into the MPEG file has not been finked, the f fow of the process returns to the step 831 to repeat the operations 
descr bed abova 

If the outcome of the judgment formed at the step 839 indk^ates that operation to record the MPEG system stream 
into the MPEG fie has been finished, on the other hand, the index fOe is cfosed to terminate the index recording proc- 
45 ess. 

In the embocfiment represented by the fkywchart shown in Rg. 13. only H the scene change flag incficates that a 
scene change has been detected by the scene change detecting circuit 1 3 1 and the scene change paranteter is greater 
than the predetermined threshoM value e is an index recorded. It should be noted that an index may also be recorded 
without regard tothe nrtagnitude of the scene change parameter. In th^ case, however, an index is appended also to a 
so frame without such a large scene change, increasing tfie nunnber of indexes as a result 

lfanyart>itrary scene clan already recorded pfoture can be played back in the course of recording of pk;tures and 
their accompanying sound, mae convenience can be reaped from the personal computer. When the user fooks at 
something else in the course of recording of pk:tures and their accompanying sound, overfooking a scene, for example, 
nme convenience can be reaped from the personal computer if ttie user is allowed to retroactively play back recorded 
55 pk;tures including the overtookedona 

tn order to provide such convergence, the sl'p recorder is designed to include a function that altows any art>rtrary 
scene of an already recorded pk:ture to be played back in the course of recording of pKtures and their acconpanying 
sound while the recording is being carried out that is. without the need to suspend the recording operation. Such a play- 
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back operation is referred to hereafter as a sfp playback operation for the sake of convenience. 

In order to carry out a sGp playback operation, the user selects a ''SGp' item from a Tlayback* tmm at the upper 
portion of the slip recorder main window 301 shown in Rg. 7. When the "Slip" item e selected. typicaOy, a playback win- 
dow 341 Gke one shown in Rg. 15 is displayed. 

On a picture cfisplay area 342 of the playback window 341 , a played back picture is displayed. On the playback incfi- 
cator 343, the current playback status is d'^played. To be more spedfic, for example, a message TLAY" indicating that 
the playback operation is uideiway, "PAUSE* incficating that the playback operation is temporarily suspended. "STOP" 
Indicating that the playback operation is halted. "SLOW" indicating that a slow playback operation is under way, T. 
SKIP" indicating that a skip operation in the forward direction is under way or "R. SKIP" indicating that a skip operation 
in the backward direction is under way is displayed on the playback indicator field 343. 

On a playback tinrie display fieU 344, one of the following 3 pieces of information is displayed as shown in Rg. 1 6: 

a lapsing period of time since a point of time recording is started (refenred to hereafter as a start point of time for 
the sake of convenience) to a position subjected to a sfip playback operatkxi (referred to hereafter as a playback 
point for the sake of convmience); 

a remaining period of time fipom the playback point to a position subjected to recordng (referred to hereafter as a 
recordng point for the sake of convenience); or 

a point of time at which a picture, that is, encoded data, at the playback point was recorded (refenred to hereafter 
as a recording point of time for the sake of convenience). 

ft should be noted that, in the case of an already recorded tape, the remaining period of time is a period from tiie 
playback poim to the end of the tape. One of the 3 pieces of inforrriation to be cfispl^ 
back time display change button 353. 

In a slip playback operatioa the relative positional relation between the playback and recording points does not 
change as kxrg as the playback point is not shifted by a slider 354 to be described later. Thus, in a slip playback oper- 
ation, if a remaining period of time is selected, time information displayed on the playt>ack time cSsplay field 344 remains 
fixed or all but fixed because the renriaining perkxJ of time is a period con-esponcfing to a di^ 
to a reoorcfing poirrt 

ft should be noted that the playback window 341 is opened not only when a slip playback operation is requested, 
but also when a request is made to monitor an input selected by the input switch button 312 of the sl^ recorder main 
window 301 or a request is made to play back a tape which has corrpleted a recording operation. When the playback 
window 341 is opened for monitoring a selected input, "-:-:-" is delayed on the playback time cfisplay field 344. 
When the playback window 341 is opened for playing back a tape which has oonrpleted a recording operation and a 
remaining period of time is selected as time information to be dsplayed on the playback time display field 344, a period 
from a playback point to the end of the tape is (fisplayed. 

On an audk> output mode display fieU 345, the current audio output vnodQ is displ^ed. TypicaUy, there are provided 
3 audio output rnodes,nafnely, a stereo aucfio output nfKxIe, a nvxie to output sou^ right and left speakers of 

theLchannel only and a nriode to output sound from the rigm and left spealers of the R channel onty^ 
output modes is selected by operating an audio output switch button 357. ft shouM be noted that, when the steeo audb 
output mode, the mode to output sound from the right and left speakers of the L channel only or the mode to output 
sound from the right and left speakers of the R channel only is selected, on the audio output nrxxJe display f ieM 345, a 
message "STEREO", "L ONLY" or "R ONLY" is respectively displayed 

A stop button 346, a playtjack button 347 or a pause button 348 is operated to respect 
suspend the playback operation. A skp button 349 or 350 is operated to skp a portk>n of the tape in the backward or 
fonward direction respectively. An index button 351 a 352 is operated to skip a portion of the tape to a frame with an 
index appended thereto that is closest to a playback point in the backward or forward cfirection respectively. 

The playback tirne c^ay change button 353 is operated to select tirne infbrrnation to to 
time disptoy fieM 344. ft should be noted that, each time the playback time display change button 353 is operated, the 
time information is changed on a rotation basts for example as follows: a lapsing period of time a remaining period 
of time -> a recording point of time a lapsing period of time — and so on. 

The slider 354 is used to change the playback point. To put ft in detail, ttie sikler 354 can be shifted typically by drag- 
ging it using the mouse 22. At that time, the playback point is changed to a position corresponding to a kx:ation of the 
sfider 354. ft should be noted that the slider 354 can be shifted horizontally along a groove provided for the motion of 
slider 354. The left end of the groove of the slider 354 corresponds to a position at whk:h recording ^ started, that ^, 
the beginning of an MPEG fila On the other hand, the right end of the groove of the slider 354 corresponcte to a record- 
ing point. Thus, the user is capable of playing back any arbitrary screen between a posftion at which the recording was 
started and a point immediately preceding a screen currentty being recorded by operating the slider 354. 

ft shouU be noted, however, that in the MPEG1 real time encoder board 21 3. a pre-encoding picture is temporanly 
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stored in the frame memory unrt 11 0 and code obtained as a result of the encoding is temporarily stored in the output 
buffer 118 as described above. In addition, it takes time to a certain degree to can^ out MPEG encoding and to store 
code obtained as a result of the MPEG encoding in the output buffer 118. Thus, a saeen that can be std>jected to a sip 
playback operation is a saeen preceding a screen cun^entiy being recorded by at least a period in the range about 10 
secorvJs to 15 seconctew 

The slider 354 can be shifted by the user as described abova In addition, the slider 354 is also shifted in a playback 
operation atong with the motion of the playback pointer. Furthermore, the slider 354 is shifted when the playback point 
is moved by operating the skp button 349 or 350, or the index button 351 or 352. 

It should be noted that when the slider 354 is shifted to change the playback pdnt. the time information dspl^ed 
on the playback time d'^play fiekJ 344 is also changed in accordance with a change in playback point position. 

With a playback operation temporarily hatted by operating the pause button 348. a frame feed button 355 is oper- 
ated to feed a frame, that is, to display a next frarne on the picture cfisplay area 342. A slo^ 

ated to carry out a slow playback operation. The audio output switch button 357 is operated to select an audio output 
mode. It shodd be noted that, each time the aucfio output switch button 357 is operated, the audio output mode is 
changed on a rotation basis for example as fblksws: the stereo audio output mode the mode to output sound from the 
right and left speakers of the L channel only ^ the mode to output sound from the right and left speakers of the R chan- 
nel only the stereo audio output mode — and so on. 

Next, a sip playback process carried out by the slip recorder is explained by referring to a flowchart shown in Rg. 

17. 

As shown in the figure, the f kiwchart begins with a step S40 at which the microprocessor 20 1 reads out an MPEG 
system stream from the head of an MPEG file of a tape currently subjected to a recording operation when the playt)ack 
window341 is operated. The fkiwoftiie process then goes on to a step S41 at which the microprocessor 201 executes 
an application program stored in the hard dec 212 to decode the MPEG system stream read out at the step S40. The 
application program, which is caDed an MPEG1 software decoder 201 A shown in Rg. 18, is an appfication program for 
carrying out MPEG decoding as will be descrit>ed later. Then, tiie flow of the process proceeds to a step S42 at which 
a result of the decoding is output 

To be more specific, at the step S42, a picture of the decocBng result is displayed on the picture display area 342 of 
the playt)ack window 341 whereas sound of ttie decoding result is output to the speakers 59 arvJ 60. 

Sidisequentty. the f of the process continues to a step S43 at which time information corresponding to a position 
in tiie MPEG system stream read out at the step S40 is displayed on the playback time display field 344 of tiie playback 
window 341 . The time information displayed on tiie playback time display field 344 is one of tiie aforementioned 3 types 
of information selected by operating tiie playback time display change button 353. The time information is found by tiie 
mk^roprocessor 201 as follows. 

As descrit>ed above, since the MPEG system stream has a fixed rate, a lapsing period of time corresporxiing to a 
position in tiie MPEG system stream read out at ttie step S40 can be found from a recording position in tiie MPEG sys- 
tem stream, that is, a recording offset from tiie beginning of the MPEG fOe expressed in tenms off byte& A remaining 
period of time can be found as a distance expressed in terms of bytes from a position in tiie MPEG system stream read 
at tfie step S40 to a position in the MPEG system stream currently being recorded. A reconfing point of time is found 
by adding the lapsing period of time to a recording start point of time stored at the head of an index file of the tape as 
desabed befora 

Pieces of time information for each position in an MPEG system stream recorded in an MPEG file can be found in 
a way described abova. It shoukJ be noted ttiat, as a typk:al altemative. a recording point of time for each point in tiie 
MPEG system stream is stored and tiie other pieces of time information can t>e found from tfie recording point of time. 

After completing tiie processing of tiie step S43. tfie ftow of tiie process goes on to a step S44 at whkrfi tiie micro- 
processor 201 forms a judgment as to whether or not tfie playback point has been changed typk^ally by shifting tiie 
slider 354 or operating tiie skp button 349 or 350. or tiie index button 351 or 352. If tiie outcome of tiie judgment formed 
at tfie step S44 indk^tes that tfie playback poim has not been changed, tiie f tow of tiie pro^ 
at whk:h a continuation to the MPEG system stream read out in the irnnriediately prececGng 
MPEG fila The pieces of processing of the subsequent steps are ttien repeated. 

If the outcome of tiie judgment formed at tiie step S44 indcates tiiat the playback point has been changed, on tfie 
other hand, the f tow of tfie process goes on to a step S45 to change a position in tiie MPEG system stream, from which 
code is read out. in accordance witti tiie change in playback point. The f tow of tiie process ttien returns to tiie step S40 
at whtoh the MPEG system stream is read out from tiie new position set at tiie step S45. 

The pieces of processing of tiie subsequent steps are tiien repeated. 

The slip playback process is terminated typtoally when tfie playback window 341 is ctosed or when tiie stop button 
346 is operated. 

As descra>ed above, during a reconfing operation, ptotures and ttieir accorrpanying sound already recorded in tiie 
hard disc 212 can be played back starting from any artritrary position while the recording operation is being continued. 
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Thus, the user is capable of viewing a desired scene withcxit si^pending the recording operation. 

In additioa since time Information Is dsplayed on the playt>ack time display field 344 of the playback window 341 . 
by referring to tfie displayed time information, the user is capable of finding a desired scene in a relatively short period 
of time 

5 It should be noted that duing a slip playback operation, data is read out and written from and into the hard disc 
212 on the soiled time sharing basis. The scheduling of the operations to read out and write data is earned out und^ 
control of the Windows 95 OS (cperating system) without any intervention in particular by the Slipcfip application pro- 
gram. It should be noted, nevertheless, that the scheduling can also be controlled by the Slipdip application program 
itself. 

10 To put it in detail, operations to read out and write data from and into a hard disc put to practi^ 

carried out at a suff ictentiy high speed, making it basically possible to carry out a slip playt>ack process by merely read- 
ing out and writing data from and into the hard disc under I/O control of the OS without the need to suspend a recording 
operation. 

As described at)ove. a picture reproduced in a slip playback operation is displayed on the picture display area 342 
IS of the playback window 341 as shmn in Fig. 15. In addition, such a picture can also be displayed on a so-called full 
screen. That is to say, the picture dteplay area 342 can be enlarged to the whole screen of the (^ay apparatus 51 . 

Next, the processing carried out by the slip recorder is explained more t>y refemng to Rg. 1 8. 

During a recording operation carried out bry the slf) recorder, in the MPEG1 real time encoder board 213. a picture 
and its acconrpanying sound are subjected to MPEG encoding to produce an MPEG system stream which is then 
20 recorded into an MPEG file of a tape created in advance in the hard disc 21 2. Then, a scene change parameter is com- 
puted from index data output by the MPEG1 real time encoder board 213. The scene change parameter is then stored 
in an index ffle of the tape aeated in advance in the hard disc 21 2 along with a scene change pointer and an identifica- 
tion flag. 

As shown in Fig. 18, at the head of the index file, a header (H) inducting a start time and a reconcfing tuode is 
25 recorded. The start time is a point of time at which recording is started. 

An identification flag, a scene change pointer and a scene change parameter are recorded in the index f De when a 
scene change flag included in index data indicates that a scene charige has been detected and the scene change 
parameter is greater than the predetermined threshold value e as shown in Fig. 19. A scene change pointer recorded 
in the index file represents a position in the MPEG file as shown in Rg. 18. At that position, encoded data of a frame in 
30 which a scene change occurs is recorded. 

In the slip playback process carried out by the slip recorder, on the other hand, the MPEG1 software decoder 201 A, 
an application program for carrying out MPEG decoding, is executed by the microprocessor 201 to read out and decode 
data from any arbitrary position in an area in the MPEG file shown as a long black rectangular in Rg. 18. In the area, 
an MPEG system stream has already been recorded. 
36 During a recording operation, the MPEG file is opened in the so-called shared mode so that the MPEG file can be 
accessed by a plurality of application programs. In the shared mode, the MPEG1 real time encoder board 213 is thus 
allowed to write an MPEG system stream into the MPEG file and, at the same time, the MPEGl software decoder 201 A 
is aDowed to read out the MPEG system stream as well. 

In the case of an endless tape, since the endless tape conrprises a plurality of fixed ta^ 
40 MPEG system stream specified as code subjected to a slip pl^rback operation may have been recorded in an MPEG 
file of a fixed tape different from an MPEG fie of a fixed tape into which an MPEG system 

real time encoder board 213 is written. In this case, the MPEG file in which an MPEG systm stream specified as code 
suljjected to a slip playback operation has been recorded is opened separately from the MPEG f fle into which an MPEG 
system stream output by the MPEGl real time encoder board 213 is written. When the read operation is finished, ttte 
45 MPEG file in which an MPEG system stream specffied as code subjected to a slip playback operation has been 
recorded is closed. 

As descrbed above, in this errtediment an MPEG system stream is recorded in an MPEG file while indexes each 
comprising an identificatk>n flag, a scene change pointer and a scene change parameter are recorded in an index file 
which is allocated separately from the MPEG file. Thus, data conforming to MPEG specifications can be stored in an 
50 MPEG file and can therefore t>e used by arxither application program. 

It should be noted that an MPEG system stream arxJ indexes can also be recorded in the same f fla In this case, 
however, it will be difficult for other application programs to use the f Oa 

If an automatic index check box 326 of the tape setting diatog box 321 shown in Fig. 8 is not checked, unlike what 
has been descrbed atxve. no index is recorded in an index file That is to s^. in this case, an index file comprises only 
55 a header. 

As descnl>ed above, recordir^ and playback operations can be carried out concun^entty It should be noted that the 
'rOormal" video recording nxxJe has been assumed and. in order to simplify the description, the amount of data of a 
video element stream is computed instead of the amount of data of an MPEG system stream. 
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In the 'Normal" video recording mode, a picture frame picture corrprises 352 pixels X 240 pixels as shown in the 
tat)leof Fig. 10. Assume that each pixel conprises typically an 8-bits Y lurninance signal and^ 
a 2-brt chrominance signal, namely, a 1-bit Cb chrominance signal and 1 -bit Or chrominance signal to givea total of 12 
k»ts. Also assume that 1 GOP comprises typically 15 frames. In this case, the amoivrt of data of 1 GOP (that is, the 
amount of data prior to encoding) is found by using the follcwing equation to be 1 ,856 KB. 

Arnount of data == 352 pixels X 240 pixete X 1 2 bits X 1 5 frames^ bits = 1 ,856 KB 

In additioa in the "Normal" video reoorcfing mode, the video rate of a video elementary stream in the MPEGl real 
tinte encoder board 213 is 1,151 ,929 bps and the franie rate is 30 frarnesfeecond as shorn in the table of Fig. 10. Thus, 
picture data of 1 GOP which comprises 1 5 frames as descried above ts compressed into an amount of data expressed 
by the following ecfuation: 

1.151,929/30 frames X 15frames/8 bit » 70.3 KB 

Thus, in this case, the ptcti^e data is compressed at a conpression ratio of 1/26.4 (= 70.3 KB/1 ,856 KB). 

By the way. the inventor of the present invention has found out through measurement that the transfer speed of a 
certain HDD is about 4 MB^second. At this transfer speed, the 70.3KB compressed data of 1 GOP can be stored in the 
HDD in about 1 7.2 ms (= 70.3/(4 X 1 ,024)). 

Thus, even if a very long head seek time of the HDD. for example, a head seek time of 20 ms. is assumed, the 
length of time it takes to store compressed data of 1 GOP into the HDD is about 37.2 ms (= 1 7.2 ms + 20 ms). 

On the other hand, a transfer speed at whk;h data is read out from the HDD Is generally hig^ 
fer speed. Assume that the read trar^fer speed is the same as the write transfer speed and that the re^ seek time is 
also the same as the write seek time which is 20 ns as desaibed above. In this case, the length of time it takes to read 
out compressed data of 1 GOP from the HDD is also about 37.2 ms. 

Since 1 GOP cprnpnses 1 5 frarnes. it takes about 0.5 seconds to transfer 1 GOP at 
ond. Sincecorrpresseddataofl GOP can be read out and written in about 74.4 ms (= 37.2 ms + 37.2 ms), operations 
to record and play back pictures can be earned out concurrently diFing a transfer pe^ GOP which is about 0.5 
seconds. 

It should be noted that, in the case of the "Long" vkleo recorcfing mode, the amount of data of 1 GOP prior to com- 
pression is 394 KB and reduced to 22.9 KB by encoding. Thus, the data is compressed at a corrpressiori ratfo of about 
1/17.2. Consider an HDD having the same specifications as the "Islormal" video recording mode descri>ed above, tn 
this case, since the length of time it takes to store or to read out compressed data of 1 GOP Into or from the HDD is 
about 25.6 ms. operatfons to record and play back pictures can also be carried out concurrently during a transfer period 
of 1 GOP which is about 0.5 seconds. 

By the way. since Windows 95 is an OS having a multitask functfon, other processing can be carried out while an 
operation to write an MPEG system stream into the hard disc 212 is in a wait stata Thus, if the user peribrms an oper- 
ation requesting that other processing be camed out in the course of a slip playback, the other processing may be 
implemented even if an operation to write an MPEG system stream into the hard cGsc 21 2 is set at the highest priority. 
It is thus desiraUe for the user not to perform an operation requesting that other processing be carri^ 
of a slip playback. However, it is diff kxjtt to prevent all users without exception from doing such an operation. 

On the other hand, if an operatfon to write an MPEG system stream into the hard cfisc 212 is in an excessively long 
wait state that can not keep ip with the bit rate of the MPEG system stream, the MPEG system stream wiO be 
destroyed, making it (Sft'tcdti to decode the stream. It is thus necessary to absolutely prevent an MPEG system stream 
from being destroyed. 

In case an operation to write an MPEG system stream into the hard disc 212 can not keep tp with the bit rate of 
the stream, encoding carried out by the MPEGl real time encoder board 213 is suspended under control executed by 
the controller 133 shown in Fig. 6. 

Fig. 20 shews a f towchart representing the control executed by the controller 133 whk:h monitors the amount of 
data stored in the output buffer 1 1 8 as described befora As shown In the figure, the f fowchart begins with a step S51 
to form a judgment as to whether or not the amount of data stored in the output buffer 1 1 8 is greater than a predeter- 
mined value of typk:ally 100 KB. If the outcome of the judgment formed at the step S51 indicates that the amount of 
data stored in the output buffer 118 is not greater than the predetermined value, the flow of the control goes on to a step 
S52atwhich the controller 133 controtebk)cks composing the MPEGl real time encoder board 21 3 to carry out MPEG 
encocfing normally. The flew of the control then returns to the step S51 . The reason why the predetermined value is set 
typically at 100 KB is that the typical storage capacity of the output buffer 1 1 8 is 1 60 KB as described before. It means 
that, if there Remargin or a free area of at least 60 KB in the output buffer 118. the MPEG encoding carried out by the 
MPEGl real time encoder board 213 is continued as it iSw 
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}f the (Hitcome of the judgment formed at the step S51 indicates tttat the amount of data stored in the output buffer 
11 8 is greater than the predetermined value 1 00 KB. on the other hand, the flow of the control goes on to a step S53 at 
which the controller 1 33 suspencte or temporarily hafts the encoding carried out by the MPEG1 real time encoder board 
213. To be more spectfic, the controDer 133 typically neither lets fTx>re pictires be stored in the frame menwry unit 110 

5 nor a picture t>e read out from the frame memory unit 1 1 0. As a resuft. the operation to write the MPEG system stream 
into the hard (fisc 212 is also discontinued as well. To put it accurately, a device driver of the hard cfisc 212 does not 
make a request for an MPEG system stream anymore. Thus, if the amount of data stored in the output buffer 1 18 
exceeds 100 KB, leaving only a free area smaller tttan 60 KB in the buffer 1 18, the controller 133 suspends or tempo- 
rarily halts the MPEG encoding carried out by the MPEGl real time ertcoder board 213. 

10 The flew of the control th^ goes on to a step S54 at which the controDer 133 forms a judgment as to whether or 
not the amount of data stored in the output buffer 118 s smaller than a predetermined value of typically 50 KB. If the 
outcome of the judgment formed at the step S54 indicates that the amount of data stored in the output buffer 11 8 is not 
smaDer than the predetermined value, the flow of the control returns to the step 54. If the outcome of the judgment 
formed at the step S54 indicates that the amount of data stored in the output buffer 1 1 8 is smaller than the predeter- 

15 mined value, that is, if an operation to write an MPEG system stream into the hard disc 212 which has t>een put in a 
wait state so far is started to extract data from the output buffer 118. reducing the amount of data stored therein to a 
value smaller than 50 KB, on the other hand, the flew of the control goes on to a step S55 at which the controller 133 
requests the MPEGl real time encoder board 213 to resume the encoding. To be more specific, the controller 133 typ- 
ically lets more pictures be stored in the frame m&rjofy uiit 1 1 0 and a picture be read out from the frame memory unit 

20 110. Then, the flow of control returns to the step S51. 

Asdescrfoed ^tx>ve, in case an operation to write an MPEG system stream into the hard disc 21 2 can not 
with the bit rate of the stream, encoding carried out t>y the MPEGl real time encoder board 213 is suspended. H is thus 
possible to prevent the MPEG system stream from being destroyed. 

It should be noted that, during an encoding suspension period, a picture suppGed to the MPEGl real time encoder 

25 tx>ard 213 is not stored in the frame memory unit 1 10 and. thus, not recorded. Since the numt>er of such frames is 
expected to be not so large, however. rK> big problem is raised in corrparison with a destroyed MPEG system stream. 

As descrit)ed above, when a free area left in the output buffer 118 becomes smaller tfmn 60 KB in size, the MPEG 
encodng cam'ed out t>y the MPEGl real time encoder board 213 is suspended because of a reason descrit>ed as fol- 
low. The MPEG encoding canied out by the MPEGl real time encoder board 213 can be suspended only on a frame 

30 boundary. That is to say. once the MPEG erxxxfing of a frame has been started, the ertcoding of the frame can not be 
suspended till the encoding is completed. A largest amount of data obtained as a result of MPEG encoding is output t>y 
intraframe encoding and. in general, the amount of data obtained as a result of intraframe encoding is expected to be 
about 40 KB. 

Is obvious from the above discussion that data of the order of alxxit 40 KB rn^ be supplied to 118 
35 even if an attempt is made to suspend MPEG encoding. For this reason, it is necessary to assure that a free area with 
a size of at least 40 KB for accommodating such data is still left in the output txiffer 118 be/tore MPEG encoding can be 
suspended. 

That is wtty. in this emtxxliment, when a free area left in the output buffer 118 becomes smaller tfian 60 Kb; the 
MPEG encoding is suspended. It should be noted that the nurTt>er 60 KB is obtained by adding a safety margin of 20 
40 KB to the data amount 40 KB. 

Next, tiie dip editor is activated to edK pictures recorded by using the slip recorder. When the dip editor is activated, 
a dip editor main window 361 like one shown in Rg. 21 is displayed. 

With the dip ecfitor main window 361 displayed, the user specifies a dip as an otsject to be edited. 

As descrfoed above, while a dp t>asically has the same meaning as a tape, in the desaiption of the dp editor, the 
45 term dip is used. Thi^. a dip comprises an MPEG file and an index f Oe. 

When a dip is specified, a source window 362 is displayed on the dp editor main window 361. Index screens of 
the specified dip are further displayed on the source window 361 . 

To put it in detail, the microprocessor 201 executes the MPEGl software decoder 201 A shown in Rg. 1 8 to decode 
encoded data of frames stored in the MPEG file of the specified dip at locations pointed to by scene change pointers 
50 Stored in the index file of the same dp The rrdcroprocessa 201 then cfsplays shrunk screens of ttie decoded frames 
as the index screer^ on the source window 362. 

It should be noted ttiat, above each of the index screer^ a name for identifying tiie index screen displayed. In 
the errtxxliment shown in Rg. 21 , examples of ttie names displayed above the index saeens are Auto 0. Index 1 . Auto 
2 and Auto 3. 

55 In the exanrples. the narnes "Auto n" where n is a nuniiber indicate that the irdexsae^ 

matic indexes. On the other harvi. the name "Index n** where n is a numt>er is a default name indicating that the index 
screen is associated with a manual index. 

As descrfoed atxive. an automatic index is apperxied during a recorcfing operation while a manual index can t>e 
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appended to any arbitrary location on the source window 362 when the user operates typically an index adding button 
366a on a tool bar of a dip editor main wirvJow 362. It should be noted that the location corresponds to a position on 
the MPEG system saeen limited to the head of the GOP in the case of a manual index. 

It is worth noting that, in an "Index" menu of the dip editor main window 361 , there is induded a "Change to manual 
5 index" item which can be dicked to change an autonriatic index to a iTianualind 

to a manual index, the name of the index screen representing the automatic index remains unchanged as it is. That is 
to say. the name "Auto n" is not changed to the name "Index n". An automatic index is changed to a manual index by 
inviting the identtfication flag of the index. 

In addition, the name of an index saeen associated with an automatic index appearing on the dip editor main win- 
10 dGw361 Is displayed in a color diff^ent from the narrie of an index screen associated with a niari^ Inthisway, 
an index saeen associated with an automatic index and an index saeen assoctated with a manual index can t>e dffitin- 
guished from each other with ease. 

An automatic or manual index can be deleted by operating a delete button 366B induded in the tool bar of the dip 
editor main window 361 . 

75 At the bottom of the source window 362, a tirne line 363 used as a tirne axis is displayed. Typically, the left edge of 
an index saeen coincides with a corresponcfing point of time on the time line 363. It should be noted that the corre- 
sponding point of time on the time line 363 is a time at wfvch the index saeen is recorded with the start of the recording 
taken as a reference. 

An index saeen is basically the first frarne of a scene dianga Thus, frarnes from an index saeen to a fram^ 
20 diately preceding the next index saeen basically constitute a scena Therefore, the user is capable of searching index 
saeens for a desired one with ease. 

Wh&i it is desired to confinn a picture after index saeens have been displayed, a point on the time Bne 363 is 
dragged k>y using the mouse 22 atong the time line 363 ever a desired range. By doing sol the traced range is denoted 
by the syrrbol R in Rg. 21 and the range R is taken as a playback ranga Then, when a playback button 367 induded 
25 in the tool bar of the dip editor main window 361 is dtoked, for exanple, a playback opmtbn is carried out over the 
playt>ack range R. 

To put it in detail, in this case, the playback window 341 shown in Fig. 15 is typically opened. Thea the MPEG1 
software decoder 20 1 A is es^cuted to decode an M PEG system stream corresponding to the playback range R and dis- 
play pictures resulting from the decoding on ttie picture display area 342 of ttie playback window 341 . 
30 As a result, the user is capat)le of confirming a scene witti ease. 

The user looks at index saeens and. if necessary, further conforms a scene to detennine a scene to be used in edit- 
ing. The user then dicks an edit point fOe aeation button 368 induded in the tool bar of the dip editor main window 361 
to (fisplay an output window 369 beneath the source window 362 on the dip editor main window 361 as shown in Rg. 
21. 

35 After the output window 369 ^displayed, the user traces a range on the tirne Bne 363 in the 80^ 
dragging using the nfK>use 22. An index saeen in the range is copied as a scene to a new dip. 
on the source window 362 from an index saeen at the beginning of ttie traced range to a frame immediately preceding 
an index saeen immediately succeeding the traced range is the object to be copied to the new dp. On ttie time One 
363 of ttie source window 362. a start mark 364Land an end mark364R are displayed at positions corresponding to 

40 ttie start and end points of ttie object to be copied respectively A background on ttie source window 362 in ttie area 
taken as ttie obj ect to be copied and ttie traced range on the time line 363 are displayed in a cok>r different from ttie rest. 

TTie area is copied to ttie output window 369 by carrying out operations as follows. Whm 
is moved to a position in the area of ttie object to be copied and ttie nriouse 22 
the shape of the cu^ is changed from typk»lly a shape resenft)fing an arrow to a shape synM 

45 It should be noted that the cursor rtseH is not shown in the f igura Witti the mouse 22 pressed as it is. the cursor is 
dragged to a position In the output window 369. As the mouse 22 is released from the pressed stata the index saeen 
pointed to by ttie cursor is copied from the source window 362 to the output window 369. In the embodiment shown in 
Rg. 21, a scene witti an index saeen named "Auto 0" serving as the head frame ttiereof and a scene witti an index 
saeen named "Auto 2" serving as ttie head frame ttiereof have been copied from the source window 362 to ttie output 

50 window 369. 

It shouti be noted that, when an object to be copied is copied from the source window 362 to ttie output window 
369. all automatic indexes in the object are deleted from the output window 369. In addition, if the head frame of an 
object copied has an appended automatic index, the automatic index is changed to a manual index. 

All automatic indexes in ttie copied object are deleted from the output window 369 fa ttie following reason. The 
55 video CD aeator, one of the application programs of ttie Slipdip softwara can be used to aeate a video CD for record- 
ing scenes copied to ttie output window 369. VVhen a video CD is aeated by ttie video CD aeator. an index conforming 
to video CD specifications is set at a kx^tion pointed to by each scene change pointer recorded in ttie index file. 

An automatic index is provkled to he^ the user find a desired scene witti easa Basically, a large number of auto- 
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matic indexes are recorded, tf the targe number of automatic indexes are not deleted, they wID remain in the video CD 
created by the video CD aeata. 

On the other hand, each automatic index of the head frame of an object copied to the output window 369 is 
changed to a manual index because of the following reason. The head frame of a copied object con-esponds to an ecfit 
point It desirable to keep an index also for an edit point inavideoCD. tf an automatic index of the head frame of an 
object copied to the output window 369 is not changed to a manual index, the automatic index will be deleted. Thus, an 
automatic index of the head frame of an object copied to the output window 369 is changed to a manual index in order 
to prevent the automatic index from being deleted. 

As a result, only manual index saeens associated with manual indexes are displayed on the output window 369. If 
it is desired to leave an index at the position of an automatic index, it is necessary to change the automatic index to a 
manual index in the way deserved earfier before copying an object to the output window 369. 

It should be noted that an automatic index can be prevented from being deleted even if an object including the auto- 
matic object is copied to the output window 369. In addition, it is also possible to prevent an automatic index of the head 
frame of an object copied to the output window 369 from being changed to a manual index. 

As descried above, the user is capable of copying a desired scene to the output window 369. In addition, since 
the user is also capable of moving, deleting and rearranging scenes copied to the output window 369. the \js& is 
allowed to carry out editing by doing such work if necessary. 

Then after desired scenes are rearranged in a desired order on the output window 369. it may be desired to newly 
create a dip lor storing the rearranged scenes. In this case, a build start button 370 included in the tool bar of the dip 
editor window 361 is typically operated to create such a new dip 

When the build start button 370 't& operated, the microprocessor 201 reads out encoded data of the desired scenes 
laid out on the output window 369 from the MPEG f Be by referring to the index file. After necessary processing is carried 
out for each j unction point (or edit point) with elementary data (or an el ementary stream) of the encoded data read out 
from the MPEG file used as it is, only system encoding is performed again. Results of the encoding are stored in the 
hard disc 212 as a new MPEGfAe. 

ft should be noted that, at the same time, an new index fSe for index saeens cfisplayed on the output window 369 
is also created. It is obvious from the above description that the new index file will indude only manual indexes and 
include no automatic indexes. The new index file and the newly aeated MPEG file are stored in the hard disc 212 as a 
newdf). 

As descrfoed atxsve. index screens associated with automatic indexes staed in the index file are dsplayed on the 
source window 362. A large number of index saeens separated away from each other by not so large intervals may 
thus be displayed on the source window 362. adversely forming a hindrance to a search carried out by the iser for a 
desired scena 

In order to sdve the problem descrfoed above, in thte embodinmnt, index saeens assodated with automatic 
indexes stored in the index file can be displayed on the source window 362 conditionally. That is to say, only index 
saeens satisfying a certain condition are displayed on the source window 362. For the sake of convenience, such a 
condition is referred to hereafter as a display condrtioa 

Fig. 22 is a diagram showing an index display level setting dialog box 381 used tiy the user for setting a display con- 
dition. 

It should be noted that the index display levd setting dialog box 381 can be displayed typically by diddng an "Index 
display level setting" item in a Display" menu off the dp ecBtor main window 361 shown in Fig. 21. 

A "displ^ air field 382 on the index display level setting datog box 381 is specified by being dicked to set a display 
condition which stipulates that index saeens associated with all automatic indexes recorded in an index fie be ds- 
played. A level f ieM 383 is specified by being dicked to set a display condition which stipulates that only index saeens 
associated with automatic indexes with the scene change parameters thereof exceeding a predetermined threshold 
value be displayed on the source windm 362. The threshold value is entered by the user to a threshdd value irput field 
383A. 

A saeen count field 384 is specified by being dicked to set a display condition which stipulates that only up to a 
spedfted number of index saeens associated with automatic indexes having large scene change parameters be dis- 
played on the source window 362 with automatic indexes having large scene change parameters given high priority. 
The maximum number of index saeens is specified by the user to a "maxinrwm number of saeens to be cfisplayed" field 
385. 

A maximum level display field 386 is specified by being clicked to set a d^y condition which stipulates that only 
an index screen assodated with an automatic index having the largest scene change parameter in each of intervals t>e 
displayed on the source window 362. The length of each interval is entered by the user to tinte interval input fields 387. 

When one of the display conditions described above is selected, the number of automatic indexes to be displayed 
under the selected concfition and the total number of all automatic indexes recorded in the index ffle are displayed on a 
"Nunrfoer of displayed indexes/Total number of all indexes" fieU 388. 
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K should be noted that an OK button 389 is operated to confirm set items newly entered to the index display level 
setting dialog box 381 and to dose the index dsplay level setting dialog box 381. A cancel button 390 is operas 
keep set items previously confirmed and entered to the index display level setting dialog box 381 and to dose the index 
d'^play level setting dialog box 381 . A help button 391 is operated to display explanations for helping the user under- 
stand the index d^play level setting dialog box 381 . 

Thus, only index screens associated with automatic indexes stored in the indexf ile are dspl^ed on the source win- 
dow 362 shown in Fig. 21 in accordance with a display condtion set by using the index dsplay level setting cCalog box 
381 as described abcva 

Fig. 23 shows a flowchart representing an index saeen displaying process to display index screens on the source 
window 362 conditionany As shewn in the figure, the flowchart tiegins with a step S61 to form a judgment as to whether 
or not the "display air field 382 is selected. If the "d'splay air field 382 is found selected, the flow of the process goes 
on to a step S62 at which index saeens associated with all automatic indexes recorded in an index file are displayed 
on the soiree window 362 and the process is finished. 

If the outcome of the judgment formed at the step S61 indicates that the "display all" field 382 is not selected, on 
the other hand, the flow cf the process goes on to a step S63 to form a judgment as to whether or not the lev^ 
is selected. If the level field 383 ^ found selected, the fbw of the process goes on to a step S64 at which the index file 
is searched for automatic indexes with the scene change parameters th^eof exceecfing a predetermined threshold 
value entered to the threshold value irput field 383A. The flow then proceeds to a step S68 at which only index saeens 
assodated with the automatic indexes found in the search are displayed on the source window 362. The process is then 
finished. 

If the outcome of the judgment formed at the step S63 indicates that the level" field 383 » not selected, on the 
other hand, the flow ol the process goes on to a step S65 to form a judgrnem as to whether or not t^^ 
384 is selected. If the saeen count field 384 is found selected, the flow of the process goes on to a step S66 at which 
the index fDe is searched for n automatic indexes having largest scene change parameters where n is a nuntber spec- 
ified in the "maximim number of saeens to be displayed" field 385. The flow then proceeds to the step S68 at which 
only index saeens associated with the n automatic indexes found in the search are dteplayed on the source window 
362. The process is then finished. 

If the outcome of the judgment formed at the step S65 indicates that the saeen count field 384 is not selected, that 
is, neither the "display air field 382, the level field 383 nor the saeen count field 384 is selected or. in other words, the 
maximum level display field 386 is specified, on the other hand, the flow of the process goes on to a step S67 at which 
the irxJex file is searched for an automatic index having a largest scene change parameter in each of intervals where 
the length of each interval has been entered by the user to time intenml input fields 387. The flow then proceeds to the 
step S68 at wNch only index saeens assodated with the automatic indexes found in the search are displayed on the 
source window 362. The process is then finished. 

As desaibed above, since the number of index saeens cfisplayed on the source window 362 can be limited by, 
among otiier things, the magnitudes of scene change parameters, the user is capable of finding a desired scene with 
ease. 

In this embodiment with the level field 383 selected, the threshold value of the scene change parameter which is 
normally specified bf the user in a threshold value input f ieU 383 A can be changed without re-opening the index cfisplay 
level dialog box 381 . That is to say. the threshold value can be changed by operating a d^ 
ton 365B of the tool bar of the dip editor main window 361 shown in Fig. 21 . To be more specific each time the down 
button 365A is operated, the scene change parameter is deaemented by 1 . As a result, the number of displayed index 
saeens inaeases due to a smaller threshold valua Each time the up button 365B is operated, on the other hand, the 
scene cfiartge parameter is inaemented by 1 . As a result, the nurTt)er of displayed index saeens deaeases due to a 
larger threshold valua 

As described atxve, the number of index saeens each associated with an automatic index limited by adispl^ 
condition. It should be noted that such linitation also can t>e applied to manual indexes as wen. 

Assume that a dip (or a tape) is aeated by using the slip recorder and the dip is edited by using the dip edita to 
give a new dipi The numb^ of dips thus inaeases. If there are a r^jmber of dps. tt will be difficult to identify the con- 
tents of each of the cfips from the file names of the dtps only. In order to solve this problem Slipdip irx^ludes an appli- 
cation program called the dp viewer. 

When the dip viewer is activated, a dip viewer main window 401 like one shown in Fig. 24 is displayed. 

As shewn in thefi^re, the dp viewer main window 401 indudes a dip view 402 a showing representative sae^ 
of each dp cataloged in a dip collection. 

Ad(p collection is a folder used for classifying dippers. A representative scene of a dip ©one of saeens conrpos- 
ing the dip. By default, the first saeen cf a dp is the representative saeen of the dqx The representative saeen of a 
dip can be dianged from the defoult saeen. that is, the first saeen. to another saeen of the same dip. 

On a tab 402A. names assigned to dip collections are dteplayed. Thus, in this embodiment, 3 folders exists each 
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as a dip colleclion. The names assi^ied to the 3 cOp coDections are "Summer Travels". "Ski Tournament" and "Christ- 
mas\ K should be noted that a dip collection is selected by cncking the name 

lection. When a dip collection is selected, representative saeens of dps cataloged in the selected cfip collection are 
displayed on the dip view 402. In the embocfiment shewn In Rg. 24, a dip colleclion named "Summer TraveT has been 
5 sheeted and representative saeens of 3 dips cataloged In the dip collection named "Summer Travel" are d^^ed on 
the c^ view 402. 

When one of the representative saeens displayed on the dp view 402 rs dicked, index saeens of a dip repre- 
sented by the dicked representative saeen arecfisplayed on an index view 403. 

On a p'cture display area 404, on the other hand, played back pictures of the dp represented by the dicked repre- 
10 s^Tlative saeen on the dip view 402 are displayed. At the same time, the title of the dp represented by tite dicked rep- 
resentative saeen on the dp view 402 ^ displayed on a titie fiekJ 405. That is to say. ^ 
be given a titie which is displayed on the titie f iekJ 405. 

A stop button 406, a playback button 407, a pause button 408, skip buttons 409 and 410, index buttons 41 1 and 
412, a slider 414. a frame feed button 415 and a stmv playback button 416 have the same functions as tiie stop button 
IS 346. tiie playback button 347. ttie pause button 348, tite skip buttons 349 and 350, the Index buttons 351 and 352, the 
snder354, the frame feed button 355 and ttie slow playback button 356 of tiie playback window 341 shown in Rg. 15 
respectively 

A full saeen button 413 is operated to cfisplay the saeen display area 404 on the full saeen. An explanatory 
description of a dip selected from tfiose displayed on the dip view 402 is displayed on a description field 41 7. That is 
20 to say. witii the dip viewer, each dip can be explained by a description which is cfisptayed on ttie description field 41 7. 
As de8crik>ed above. In this embodiment, pictures are encoded and conpressed and code resulting from the 
encoding and oompressicn is then recorded. It should be noted, however, that ttie above desaiption is not intended to 
be construed in a lirrating sensa That is to say, the scope of the present Invention is not Gmrted to such an emtxxfiment. 
For example, the present invention can be applied to an application wherein pictures are recorded as they are witiiout 
25 being encoded, ^^ever, whether or not a slip playback function can be executed 

and the head seek time of the hard disc 212 and the aniount of data to be recorded or tiie data rat& 

To put it in detail, for example, consider a hard disc 212 witti a transfer rate of 4 Mbps and a head seek time of 20 
ms as is the case of the embodiment desaft>ed abova 

Assune that in recording and playback operations, tiie amount of data per frame is the same as the "Nomrtal" video 
30 recorcfing mode and consider a transfer of 15 frames or 1,856 KB as computed before. The lengtti of time it takes to 
write a read out 1.856KB picture data into a from the hard disc 212 is about 453 ms(» 1,856 KB/4 x 1,024 [KB/secD. 
Taking the 20ms head seek time into conskjeration, ttie write and read times are both about 473 ms. In order to carry 
out operations to read out and write picture data of 1 5 frames concurrentiy. it takes about 946 ms (= 473 ms -i- 473 ms) 
which exceeds a period of time of about 0.5 seconds, a period coresponding to 15 frames at a frame rate of 30 frames 
35 per second as descrS>ed previously. Thus, tiie operations can not be canied out concurrentiy during tiie 0.5sec period 
of tima 

Consider now a "Long* video recording mode in place of "NamaT witii ttie ottier conditions in tiie read and write 
operations remaining unchanged. In ttiis case, the amount of pk^jre data of 1 5 frames is 394 KB. The lengtti of time it 
takes to write or read out 394KB pkmire data into or from the hard disc 212 is about 96.2 ms (» 394 KB/4 x 1,024 

40 [KBfeecQ. Taking the 20ms head seek time into consideration, the write and read times are both about 1 16.2 ms. In 
order to carry out operations to read out and write picture data of 15 frannes concurrently, it ta^ 
1 1 6.2 nis + 1 1 6.2 nris) which is shorter ttian a period of tirr» of about 0.5 seconds, a period cor^ 
at a frame rate of 30 frames per second as desaft)ed previously. Thus, the operations can be carried out concunrentiy 
during the 0.5sec period of time. 

45 As described above, in ttie embodiment, picture data » subjected to encocfing confaming to MPEG1 spedftea- 
tions, one of fixed rate encoding techniques. It shouti be noted, however, ttiat ttie technique of encoding pkiture data is 
not limited to ttie encodng confbrnrBng to ttie MPEG1 specifications. As a matter of fact, picture data can be encoded 
at a variable rata With pkrtire data encoded at a variable rate, however, it is diff k:uH to detect ttie location at which 
encoded data is recorded from the number of t^tes representing an offset relative to a recording start position In 

so processing such as a slip playt)ack operation. 

Also as descrO^ed atxive. in the embodiment a slip playt>ack operation is carried out to reproduce pictures and their 
accompanying sound. It s worth noting, however, ttiat a slip plc^ck operation can also be carried out to reproduce 
ottier data. By the sarne token, a tape can be alk)cated for recording data other ttianpictires and so^ 

According to a picture processing apparatus claimed as daim 1 and a picture processing mettxxi daim as daim 9, 

55 a scene change parameter representing a degree of a scene change in a pkrture is corrputed: and ttie scene change 
parameter and position inforrnation on a position of the pk^ture witii a degree of a scene change ttiereofrepres 
ttie scene change parameter are recorded by associating ttie scene change parameter witti ttie position information. 
In adcfition. a recording medium according to daim 10 is used for storing a program to let a computer process a 
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picture wherein the program prescribes a picture proces^ng method corrprteing the steps of: computing a scene 
change parameter representing a degree of a sc^e change in the picture; arxl reoorcfing the scene change parameter 
arid positkxi information on a position of the picture with a degree of a char>ge thereof represented by the scene 
change parameter by associating the scene change parameter with the position information. Furthennore, a recording 
mecfium according to daim 11 is used for storirig data obtained as a resuft of processing a picture in addition to ascent 
change paramet^ and position information on a position of tfie picture with a degree of a scene change thereof repre- 
sented bf the scene change parameter by associating the scene change parameter with the position information. 
As a result, a desired scene can be found with easa 

Clalnrs 

1 . A picture processing apparatus for processing a picture comprising: 

a conrputingnieans (201) for computing a scene change paraineter representing a degree of a scene change 
in said picture; and 

a recording means (201) for recording said scene change parameter and position infbnmation on a position of 
said picture with a degree cf a scene change thereof represented by said scene change paranieter by associ- 
ating said scene change parameter with said position information. 

2. A pk;ture processing apparatis according to claim 1 also having: 

a threshold value setting means (381) for setting a threshold value of said scene change parameter; and 
a display nrieans (362) for displaying a saeen of said picture at a position ff^^ 
associated with said scerte change paranieter representing a degree of a scene change equal to a 
said threshold value set by using said threshold value setting means (381). 

3. A picture processing apparatus according to cteim 1 ateohaving: 

a scene change parameter count setting means (381) for setting a scene change parameter count; and 
a display weans (362) for displaytrig screens of said pictures at positions indicated by pieces of said position 
information associated with said scene change parameters representing highest degrees of scene changes 
wherein the number of screens to be dsplayed does not exceed said scene change parameter count set by 
using said scene change parameter count setting means (381). 

4. A picture processing apparatus according to daim 1 also having: 

a range setting means (381 ) for setting a range to be searched for a scene change parameter representing a 
highest degree of a scene change among scene changes in said range; and 

a display means (362) for searching each range set by said range setting means (381) for a specific scene 
cfiange parameter representing a highest degree of a scene change among scene changes in said range and 
displaying a screen of said picture at a position indicated by said position information associated with said spe- 
cific scene change parameter. 

5. A picture processing apparatus according to daim 1 alsohaving: 

a detection means (201) for detecting a scene change parameter representing a degree of a scene change 
equal to or higher than a predetermined level; and 

a display means (303) for displaying detection of a scene change parameter representing a degree of a scene 
change equal to or higher than said predetermined level. 

6. A picture processing apparatus according to daim 1 wherein said recording means (201 ) also records said pictura 

7. A picture processing apparat^ according to daim 6 wherein said recording means has an encoding means (213) 
for encocfing said picture to t>e recorded by said recording means. 

8. A picture processing apparatus according to daim 6 wherein said recording means (201) records said picture, said 
scene change parameter and said position information separately. 
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9. A picture processcng method for processing a ptcture comprising the steps d: 



computing a scene change parameter representing a degree of a scene change in said picture; and 
recording said scerie change parameter and position information on a position of said picture with a degree of 
a scene change thereof represented by said scene change parameter by associating said scene change 
paranieter with said position information. 



1 0. A recording medhim for storing a program to let a computer process a picture wherein said program prescribes a 
picture processing method comprising the steps of: 

computing a scene change paran^er representing a degree of a scene change in said picture: and 
recording said scene change parameter and position information on a position of said picture with a degree of 
a scene change thereof represented by said scene change paranteter by associating said scene change 
parameter with said position information. 



11. A recording medium for staing data otstained as a result of processing a picture in addition to a scene change 
parameter and position information on a position of said picture with a degree of a scene change thereof repre- 
sented by said scene change parameter by associating said scene change paranieter with said position informa- 
tion. 
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